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ON ADAPTIVE CONTROL PROCESSES 


Richard Bellman and Robert Kalaba 
The RAND Corporation 
Santa Monica, California 


Summary 


One of the most challenging areas in the 
field of automatic control is the design of auto- 
matic control devices that 'learn' to improve their 
performance based upon experience, i.e., that can 
adapt themselves to circumstances as they find 
them. The military and commercial implications of 
such devices are impressive, and interest in the 
two main areas of research in the field of control, 
the USA and the USSR, runs high. Unfortunately, 
though, both theory and construction of adaptive 
controllers are in their infancy, and some time 
may pass before they are commonplace. Nonetheless, 
development at this time of adequate theories of 
processes of this nature is essential. 


The purpose of our paper is to show how the 
functional equation technique of a new mathe- 
matical discipline, dynamic programming, can be 
used in the formulation and solution of a variety 
of optimization problems concerning the design of 
adaptive devices. Although, occasionally, a 
solution in closed form can be obtained, in general, 
numerical solution via the use of high-speed 
digital computers is contemplated. 


We discuss here the closely allied problems of 
formulating adaptive control processes in precise 
mathematical terms end of presenting feasible 
computational algorithms for determining numerical 
solutions. 


To illustrate the general concepts, consider 
@ system which is governed by the inhomogeneous 
Van der Pol equation 


x + (x pik) teow xes rl) GO. bist, 


where r(t) is a random function whose statistical 
properties are only partially known to a feedback 
control device which seeks to keep the system near 
the unstable equilibrium state x = 0, x=0. It 
proposes to do this by selecting the value of yp as 
a function of the state of the system at time t, 
and the time t itself. By observing the random 
process r(t), the controller may, with the passage 
of time, infer more and more concerning the statis- 
tical properties of the function r(t) and thus may 
be expected to improve the quality of its control 
decisions. In this way the controller adapts 
itself to circumstances as-it finds them. The 
process is thus an interesting example of adaptive 
control, and, conceivably, with some immediate 
applications. 


Lastly, some areas of this general domain 
requiring additional research are indicated. 


I. Introduction 


In many engineering, economical, biological, 

- and statistical control processes, a device of one 
type or another which we shall call a Controller 
is called upon to perform under various conditions 
of uncertainty regarding the structure of the 


underlying physical processes. These conditions 
range all the way from complete knowledge to total 
ignorance. As the process unfolds, however, 
additional information concerning these factors 
may become available to the controller, which then 
has the possibility of 'learning' to improve its 
performance based upon experience, or in fact, 
actual experimentation. In this case we say that 
the controller adapts itself to its environment. 


In an earlier paper, [7], a broad and general 
foundation was laid for the mathematical study of 
adaptive processes, through the use of concepts 
from the field of dynamic programming, [4]. The 
specific purpose of this paper is to render these 
notions more concrete through the detailed study 
of some special control processes involving a 
nonlinear system with a tendency to be stimulated 
to undesirable oscillations. 


We approach the adaptive control process in a 
series of steps. First we assume that the control- 
ler has complete information concerning the behavior 
of the forcing function over time, a process which 
is referred to as a deterministic control process. 
Then we introduce some unknown factors, which 
appear mathematically as random variables having 
distribution functions which are known to the 


controller. This leads to a stochastic control 
process. Lastly, we allow the controller still 


less information about the unknown factors and 
require that the controller learn to improve its 
performance through observation of the values of 


r(t), an adaptive control process. 


In this paper, we limit the deficiency in the 
controller's knowledge to incomplete information 
concerning a random disturbing force. There are, 
needless to say, many other ways in which ignorance 
can manifest itself. Among these we may mention 
uncertainties concerning the determination of the 
state of the system and its environment by the 
sensing devices, the objective (figure of merit) 
of the process, the transformations of the state 
of the system produced by control decisions, the 
set of allowable decisions, and so on. These will 
be examined in subsequent investigations. 


Although the design and operation of adaptive 
controllers are in their infancy, interest in 
these devices runs high, [10]. The functional 
equation technique of dynamic programming, (4), 
can be used to attack a wide variety of problems 
involving the determination of optimal control 
policies for control devices having the ability to 
adapt themselves to circumstances. In particular, 
it provides a useful conceptual framework for the 
very discussion of such devices. Though on 
occasion, analytic results are obtained, [ 2) 
emphasis is upon the development of methods which 
are suitable for use in conjunction with high- 
speed digital computers having large memories. 


Some of the advantages of the dynamic programming 
approach are its suitability for use with none 
linear, as well as linear, systems, its automatic 
production of a desirable parameter study (a 
'sensitivity' or stability analysis), its straight- 
forwardness and computational feasibility, and 

its ability to incorporate stochastic elements in 
a routine fashion. 


Let us now turn our attention to an example 
which will serve to illustrate these remarks. 


2. A Feedback Control Problem 


Let us consider a system which, if uncontrol- 
led, is governed by the well-known nonlinear 
differential equation 


% + u(x” - 1)k +x =0, x(0) = e,, #(0) =e, (1) 


(the Van der Pol equation) where the dots denote 
differentiation with respect to time. This 
equation is of fundamental importance in describing 
the development of relaxation oscillations in 
triode oscillator circuits and in describing the 
operation of multivibrators. We shall call p the 
system parameter. If we introduce the function 
v(t), by means of the relation 


(2) 


<a 


then the equation in (1) can be replaced by the 
first-order system 


(3) 


x =v, x(0O) = cy» 


v=- (x> - 1)v - x, v(0) =c 


ae 
It is well-known that if of + of #0, then the 


solution of the system (3) will tend toward a 
unique periodic solution. In the (x,v) phase 
plane, this periodic solution is represented by 

a closed curve which all trajectories (except 

x = 0, v = 0) approach. Thus, when the system is 
disturbed from its (unstable) equilibrium position 
(x = 0, v= 0), a periodic oscillation tends to 
develop. Full details are available in the book 
on nonlinear oscillations by Stoker, [1]. 


Let us assume, though, that the oscillations 
are undesirable ('parasitic'), and that the 
system can be controlled by varying the system 
parameter, , in a given range in an effort to 
maintain the system as close as possible to its 
equilibrium state. 


Consider that the process begins at time O and 
terminates at time T, and that the system is 
initially in state (c,, Cy), where c, is the 


displacement, x, and c, is the velocity, X =v. 


We shall arbitrarily measure the 'cost' of 
deviation from equilibrium during the process by 


the integral 
dlp] «f(r + Iv(t)])at + exp(]x(T)] ot ia 


where exp(z) is the exponential function of z. 

We deliberately use such a monstrous function in 
order to squelch any direct analytic approach in 
embryo. Our objective will be the determination 

of the system parameter » as a function of the 

state of the system at time t and the time t itself, 


for 0 < t <T in order to minimize J[y]. The 
control function w. will be subject to a constraint 
oy < p(t) < m,, where may be negative. Notice 
that the critérion function is not the usual mean- 
square deviation, which in this case would be of 
little avail since the underlying equations are 
nonlinear. The first term on the right-hand side 
of Eq. (4) measures the cost of deviation during 
the entire course of the process and the second 
teim measures the cost of deviation at the termina- 
tion of control. 


The temptation is to view this as a problem 
in the calculus of variations, [16], in which one 
seeks to determine p = f(t) as a function of time 
over the entire interval 0 < t <T in an attempt 
to minimize the functional J. The fact that uw is 
constrained to lie between m and m, is a cause 
of some complication. Furthermore, there are no 
classical prototypes for the stochastic control 
processes we wish to study below. 


The approach which we shall use, by contrast, 
emphasizes the feedback control nature of the 
problem. We shall imbed the original problem 
within a class of problems in which we regard the 
system as being in some general state x = C5 
x = c, at the time t, and ask what the optimal 
choicé of » is under these circumstances. Notice 
(as a consequence of the usual existence and 
uniqueness results for differential equations) 
that the past history of the process is of no 
consequence in making this decision, only the 
current state. Pursuing this approach, in which 
we have a continuous decision process, [2], we 
characterize the curve up = 6(t) as an envelope of 
tangents, rather than as a locus of points, as 
would be the case were the earlier viewpoint 
adopted. 


In order to prepare the way, though, for the 
use of digital computing machines, we wish to 
reformulate the problem in terms of a discontinuous 
time variable, which will also materially simplify 
matters conceptually when we deal with the cases 
of stochastic and adaptive control. 


3. A Discrete Version 


The problem could be treated in the form in 
which it now stands, [2]. Since our objective is 
to devise methods which are particularly suitable 
for high-speed digital computational purposes, we 
prefer to reformulate the model itself in terms 
of discrete variables. It must be borne in mind 
that, in any event, digital computers consider all 
variables to be discrete. 


The time interval from O to T is divided into 
N intervals of length h so that 


Nh = T (1) 


If the system is in state (x, 5¥. ) at time kh, and 
the control decision at that tiie is to have the 
system parameter be uw, , then the new state at 
time (k + 1)h is given by the finite difference 
equations 


i 5 Gane es 


(2) 
Terenas cs - 1)y, + *| Hy 


relations which hold for k = ORO a elelp Noam s 
These equations are the finite difference 
analogues of the equations in (2.3). The cost of 
the deviation from equilibrium from time kh to 
time (k +1)h is taken to be ( 1x, + [v,| )h, 


and the cost for deviation of the final state from 
equilibrium is exp( |xyl + Ae ). The total 


cost for deviation from the equilibrium state 
during the entire process is considered to be 


N-1 


= [Cal + ryt da) + expC dag + pygl 1) 


= 3 {Hos Ayres» Hy-ap> 


the analogue of equation (2.4). Here KH, is the 


value of the system parameter selected at time kh. 
Let us assume that the system is in state (x,y) 
initially and that we seek a set of parameter 
values, [Ho Myer Mn-1] » which will winimize 


the total cost of deviation given in equation (3). 
4, Deterministic Control 


As stated, the problem requires a constrained 
N-dimensional minimization to be performed, and as 
such may be quite difficult to carry out computa- 
tionally in its native form. Even so, this 
problem is conceptually much simpler than the 
original continuous version which required a mini- 
mization over elements in a function space. To 
solve this new discrete problem we imbed the 
given decision process within a class of processes 
in such a way that we shall have a sequence of N 
simple one-dimensional optimizations to perform, 
rather than the one difficult N-dimensional 
problem. This decomposition makes possible an 
efficient machine solution. 


The imbedding is accomplished by focusing our 
attention upon determining what value between m) 


and a, of the system parameter to choose at time 


(N - k)h if the system is then in some general 
state (a,b), where k may have any of the values 
0,1,2,...,N - 1 and a and b are any real 
numbers. The original discrete problem is one of 
the members of this class of problems. Notice 
that this is the general problem of interest to 
the feedback controller, for it must decide what 
value of the system parameter to call for with the 
system in some physical state (a,b) and kh 
time units remaining before the termination of the 
process. 


To formulate the problem analytically, we 
note first that the minimal cost of deviation over 
the last k stages of the process with the system 
starting this portion of the process in some state, 
say (c),¢,), is some definite function of k and 


ec, and Cos It is, namely, the cost that is in- 


iL 
curred during the last k stages of the process 
using an optimal selection of the sequence of 


system parameter values with the system in state 
(c,,¢,) at time (N-k)h. Let us therefore 


define for k =1,2,...,N, the functions 

£.(¢).¢,) = the cost of the last k stages 
of the control process with the 
system beginning those last k 
stages in state (c,,c,), and 
using an optimal séle¢tion of the 
system parameter throughout the 
remainder of the process. (1) 


We shall determine first £,(c),¢,), then 
£,(c,,¢,), and so on, until Py (ey 2&5) has been 
determined. At the same time, we shall determine 
the optimal choices of pp to make. 

The function £4 (c,,¢5) is easily determined. 


Here we are concerned with a process which begins 
et time (N - 1)h and terminates at time Wh =T, 
with the system in state (c, ,¢,) at time 


(N - 1)h. The cost of deviation during the process 
is ( Ie] + \eol yh. If the value of the state 


parameter selected is Ht, then the state at the 
termination of the process will be given by the 
equations 


x, = ¢, + eh, (2) 


2 
Vy = %p > [H(c8 - L)e, + ee h, 


where use has been made of the formulas in (3.2). 
The cost of this terminal deviation is 


exp [Ie + cnh| + le, -h[ACet - L)e, + e,| [sh 


Consequently, the system parameter M must be 
selected so that the total cost, given by the 
expression 


|e,{n + Jc] + exp [les + ch 


2 
+ is. ~h[ H (ey - 1)e, + “| . 
is minimized. The minimizing value of for this 
one-stage process will depend on the state (c,,¢,), 


and it can easily be determined by a digital 
computer using a search technique. The bracket is 
evaluated for sample values of Kk in the range 


m) nS fk < m, and the value of i yielding the 


smallest value of the bracket is the optimal system 
parameter value. Here we see by inspection that 
la should be chosen equal to m, if 


2 2 
(ey - 1)e, > O and equal to m, if (ey - L)e, 307 


If (oF - 1)c, = 0, the choice of 4 is immaterial. 


let us denote this optimal choice of M for the one- 
stage process under consideration with the system 
initially in state (cy ,¢,) by 


KK = My (ce, ,¢,)- (3) 


We have the expression 


£5 (ce, ,¢,) = a on He [lest +]e,]h + exp lle, 
yeh Se 
+e h| + Jc “h (= ee) C5 +.C. |] 
2 Poe dala 2 , 
(4) 
where the right-hand side represents the minimum 
over all choices of H between m) and m,, of the 
expression in brackets. It is clear that this 
minimum value actually depends on cy and Coe 


Now let us assume that the functions 
£,(c),¢,), fi(c1,¢,),-++, £.(e,,¢,5), with k<N, 
have all been determined. We wish next to deter- 
mine the function F141 (Cp 2%) We do this by 


making use of the principle of optimality, 4] ? 
which is a special, but quite important, applica- 
tion of the concept of invariant imbedding, [8] . 
According to this principle, an optimal sequence 
of decisions has the property that whatever the 


initial decision and initial state are, the remain- 
ing decisions must constitute an optimal sequence 
of decisions with respect to the state which 


results from the first decision. 


To apply this principle, let us suppose that 
at time (N - k - l)h, with k +1 decisions re- 
maining and the system in some state (c_,c,), the 
first decision is to set the system parameter 
equal to HM. The effect of this decision is to 
transform the system into the state (x,,¥,) at 


time (N-k)h (when k decisions remain), where 
747 C.F coh, 


ua S [ Hey - 1)e, + c, | h. (5) 


< 
u 


From the cost point of view we see that this 
results in a cost ( Ie, zn le, yh during the 


time interval from (N - k - l)h to (N - k)h 

and (since optimal decisions must be made over the 
remaining k decisions beginning with the system 
in the state (x,5%%) given by equation (8) ), a 


2 
cost of f(c, + e,h,c, - [Mey = 1)e, + c | h) 


during the remainder of the process. Clearly, the 
‘choice of the system parameter at time (N - k - l)h 
must be made so as to minimize the sum of these 

two costs. This observation results in the 
equation 


Min 
mies toe 


+ ¢,h, c, - [Ee - Le, + co} - 
(6 


Filey »&o) = fed + Je,}h + fc, 


) 
which holds for k =1,2,...,N - l. 


In particular, since f, (ce, ,c,) is known 


from the above discussion, fp(c ) can be 


172 
determined from the formula 


£4(c,,¢,) = Jes} 4 + Jc,] + Repenee 
i eph,¢, - ics - 1)c, 
-e]}, (7) 


which follows from equation (6). The value of 
which minimizes the expression in brackets in 
equation (7) is the optimal value of H to choose 
at time (N - 2)h (the initial stage of a two- 
stage decision process) with the system in state 
(c,,¢,). We denote this optimal choice of MK by 


HM =4,(c,,¢,). (8) 


Similarly, the remaining minimal cost functions 
£,.(e,»¢,) and optimal decision functions M.(c, »¢5) 


can now be determined recursively. 


In order to apply this solution, it is 
necessary, of course, to construct a control device 
that will call for the indicated optimal value of 
the system parameter M for each state of the 
system, and time remaining. Should this prove not 
to be feasible, other sub-optimal policies will 
have to be employed. These can also be determined 
by dynamic programming methods, by imposing suit- 
able constraints on the allowable choice of and 
the information fed into the computer-controller. 
In the event of this sub-optimization, [13] ques 
loss in system performance can be quantitatively 
assessed by comparison with the performance of an 
optimal controller. 


5. Infinite Duration 


In the event that the process is of suffi- 
ciently great duration, we may wish to approximate 
to it by means of an infinitely long process. . 
Furthermore, we may now wish to exert control so 
as to minimize the maximum deviation of the 
function |x(t)| + |v(t)] over all time. 
us then define the function 


Let 


f(c) sc.) = the maximum value of |x|+ |v/ 
over all time with the system 
initially in the state (c)s¢,), 


using an optimal control policy. 


(1) 


The relevant functional equation now becomes 
a {wl Io + Keg £(c) 
—2 


+ coh, ce — (ules —1)c, + ca) | (2) 


This is based on the observation that » must be 
chosen so that the larger of Je4 + Jeo] and the 


greatest deviation over the remainder of the pro— 
cess will be as small as possible. A further 
discussion of such equations can be found in Pol, 


6. Stochastic Control 


Let us now complicate matters for the con— 
troller, somewhat, by assuming that the system is 
subjected to a random external force, the in— 
fluence of which cannot be neglected. If we 
denote the random force which is exerted at time 
kh by r,, then equations (3.2) become 


= x, + vi, (1) 


The controller can no longer predict precisely 
what state the system will be transformed into 
when a value for u is chosen, for the transformed 
state depends on the value that the random force 
r, assumes. 


For simplicity, we shall assume that the 
random variables r, are independent and that 


Prob fr, = 5} =D, (2) 
Prob fr, =— } =l-<—p, 


so that the disturbing force is either +5. The 


case where Th is correlated to the value of to 


can also be considered at some increase in 
complexity. 


We do, however, wish to assume that the value 
of p have the known value p*. This last 
assumption is not justified in many situations. 

If the value of p is not known, further compli— 
cations arise, leading to the adaptive control 
processes discussed in §7. 


Once again we wish to control the development 
of the system in such a way that 


= xp 
J= + Vv 
eee [v,[)h + exp({x,] + [vy]) (3) 


is minimized. This now can only be accomplished 


in some average sense, since x, and Vv, are random 


variables for k = 1,2,...,N. Once again we imbed 
the original process within a class of processes. 
Denoting the taking of an expected value by E, we 
define the sequence of functions 


N-l 


fc) s¢,) 2 Min E a 


(x, [o+.[¥ | )h 
a ones : : 


+ exp(|x,| ake I, (4) 
for k = 1,2,...,N, where 
Ee in Mee SAS (5) 


Thus, £.(c, sep) represents the minimal expected 


total cost of deviation from equilibrium for a 
process beginning at time (N—k)h and terminating 
at time T = Nh, with the system initially in the 
state (c)5¢,)- 


We first consider the one-stage process which 
begins at time (N — 1)h, and terminates at Nh =T. 
We have 


fi (ce) ,¢,) = Min 


mS umn. 


[c + c +e ( 
fear Jen[h xp |e, 


h 


+ 


2 
coh + le, ~ (ule, - 1)e, + c,) 


rll ; (6) 


or, taking the expected value over r. 


Bh 


N-l’ 


£1 (ce) »¢,5) = [c,|b + Jen] h (6') 


+ 


Min p* exo] fey + coh | 


my <u a, 


1 


+ Ve - (u(o% - 1)e, + c,)h + oat 


+ 


(1 - prexp| |e, + eat 
+{c, — ( (coer ile +c Jn - on] 
rg ot 2 alee’. 
Once again, this minimization can easily be per— 


formed by a computer, so that the functions 
£1 (c) »¢5) and My (ce, 5Co)» the minimizing value of 


uw for each state (cy »¢5) can be taken as known. 


Next we consider the process which is initi- 
ated at time (N — k)h with the system in a general 
state (cy 9co)» so that the process involves k 


decisions. We wish to determine the optimal first 
decision for the controller to make under these 
circumstances, and we denote the optimal value of 
u for each state (ce, »¢p) by M, (C1 »C5) + 


For any choice of the system parameter yu, the 


state of the system is transformed from the state 
(c,,¢,) at time (N — k)h into the state 


2 : 
(ce, + eoh,c, — eG = L)e, + ay h + 5a) 
with probability p* and into the state 
(c, + c,h,ec -{ (o5 —-l)c, +e ] h — Sh) 
ue eae pa aah Ber: ; 


with probability 1 — p*. Consequently, once again 
using the principle of optimality, we obtain the 
recurrence relation 


Min 


m,< + <a 


f,,.(c, »¢5) {lea + |e,|h (7) 


2] 


2 
+ pet, _y(c, + ¢oh,c, =| vey - 1)e, 
+ c, | h + 6h) 

J 


(1 — p*)f hyc 


+ 


op 


xe 'C1 + So 


-| ule - L)e, + e | h— cant, 


k = 2,3,...,N. The term in brackets represents the 
cost during the first period from (N-—k) to 

(N — k+l) , and the second the minimal expected cost 
over the remaining k —1 periods. As before in the 
deterministic case, we can determine computationally 
the desired functions £.(c)»¢5) and M.(¢1 sep), using 


2 


the foregoing recursive relations. 


1é Adaptive Control 


In some circumstances, even less information 
than was assumed in the previous section will be 
available to the controller concerning external 
influences which may affect the behavior of the 
system being controlled. Provision may be made, 
though, for the controller to "learn" about the 
nature of these influences, as the process unfolds. 
It may then be able to improve its control decision— 
making capability in the course of time. In this 
sense the controller adapts itself to circumstances. 


Observe that we are using the word in a quite 
precise sense. There is nothing mystical about the 
machine "thinking" or "creating" or "learning" in 
this restricted sense. That the human mind works 
in this way, or that the machine in any sense 
approximates the behavior of the human mind, can 
only be concluded on the basis of a rash evaluation 
of the possibilities of a digital computer or a 


brash contempt for the power of the human mind. 


Let us return to our nonlinear system which 
is being disturbed by a random force. Let us now 
deprive the controller of the knowledge of the ex— 
act value of p. The controller still knows that 
Fee 5, but the probability of each outcome is 


not known. Although this is an unpleasant situa— 
tion, this controller is still much more fortunate 
than one that does not even know the form of the 
distributions of the variables r_, or their degree 
of correlation. We shall not enter into a dis— 
cussion of such matters here. 


We can proceed with the design of an adaptive 
controller along the following lines. The state 
of the system will be characterized now not only 
by a position and a velocity, but also by a cur— 
rent estimate for p, which in the absence of 
further information we shall agree to regard as 
the precise value of the probability that Th =+056 


At any particular stage of the process when a 
control decision is made, not only does the system 
change state physically, but on the basis of the 
knowledge of the original physical state, the 
transformed physical state and the parameter value 
(uy) chosen, the controller can determine the sign 
of the unknown force for that stage. This may 
lead the controller to change its estimate of p. 
But how shall the estimate be changed? 


Though there are many ways of answering this 
question, let us indicate one specific approach. 
Let us regard p itself as a random variable with 
an a priori probability density function w(x), 
{sei 5 


Prob {a <p<a +afe wla)A + tee (1) 


As the initial estimate of p*, a value we shall 
call Py» we take the expected value of p, 


i 
P) = ap xw(x)dx. (2) 
(@) 


Upon observing that a positive disturbing force is 
exerted, r = + 5, our new estimate of the prob— 
ability density function for p will be given by 


(x) = Xw( xX 3 
oS eae 2 


Upon observing a negative disturbing force, r = — 8, 
we shall change our estimate of the probability 
density function to 


w(x) = 1 — x)w(x . i 
atk wp se (1 — x)w(x)dx (4) 


Here we have adopted a Bayes approach, (a5). This 
is the procedure adopted in |6,7,9 |. Consequently, 
after observing a positive disturbing force, the 
new estimate of p* itself is 


He t x-w(x)ax 
O 


xw(x)dax 


(5) 


oF 


and after observing a negative disturbing force, 
the new estimate of p* is 


se = x(1 — x)w(x)dx 

e) 

sh - (1 — x)w(x)ax 
(@) 


By way of summary we may note that if the a 
priori choice of probability density function is 
w(x), then after m positive and n negative forces 
have been observed the new estimate of the density 
function is 


(6) 


and a a: the new estimate of p* itself, is 
3 
sf eae — x) w(x)ax 
Pe he Oe eS ens 
ae 4 By — x) w(x)ax 
(@) 


The controller is to act as if this estimate is 
the exact value of p*. This should be recognized 
as an assumption of our analysis. 


; (7) 


The integrals in equation (7) simplify if 
w(x) is the density function for a beta distri- 


bution, 
Pe oe =e ngs ’ a,b > OF (8) 
oe a,D 


where B(a,b) is the beta function. Great flexi- 
bility in the shape of the curve of w(x) can be 
achieved by selecting the parameters a and b 
appropriately. For this choice of w(x) we have 


Sie a. daa 60 i 2th tax 
fe) 


Pain ae al etert E. x)etom-t ay 
6) 


_ Bilm+a+1, n +b) 
~ Blm + a, n +d 

4 (m+a 

~ (m+a)+(n+b) ° 


The parameters a and b play the roles of the a 
priori numbers of positive and negative forces 
observed. If the sum is small, not mich weight 
is given to the initial estimate; if it is large, 
many periods of the process are required before 
the estimate of p* can be significantly changed. 


(9) 


We now take up the problem of determining the 
optimal decisions for the controller to make. 
First the function w(x) is chosen and it is then 


held fixed. 
functions. 


Then we define the sequence of 


£,,.(c, ,¢,3m,n) = the expected cost of control 

Over the last k stages of a 
process in which initially 
the system is in physical 
state (c,,c,) and m posi- 
tive and n negative forces 
have been observed, uSing an 
optimal control policy. 

In taking expected values we shall assume that 

current estimates of distributions are the true 

distributions, consistent with our previous 

practice. 


(10) 


For the k-stage process we find (11) 


f,.(c, »¢,3m,n) = |e Ih+ Ic, [fh ; 
M0 Patina eer ee ola, 


* mus 
+0, [beh jm+1 nm) 


2 
+ (Py) Peg (ey+eghs eg-[u(e}-2)e9 
+c, }n-8hm,n+1) b 


for k='2,3,...,N, and for the one-stage process 


£1 (c, ,c,sm,n) = Jo, | b+ leo] h (12) 


2 
+ Min Jp exp(|c,+eh| + fog [Cer ¢0 
<<, m,n 


aD 


+ (1p, ,)exp( Tey +eph] + foo [u(cs-2)e, 


+e}-en))}. 


As before, the functions fy and the decision 
functions (c, ,¢p smn) are to be determined 
recursively. 


The numerical resolution of equations (11) and 
(12) presents some difficulties, however, in that 
sequences of functions of four arguments are to be 
determined. Several methods present themselves 
for consideration, however. In particular, we 
note that when m+n is large we can assert with 
some confidence that m/(m + n) is a good estimate 
for p*. The decisions called for in the solution 
of the stochastic control process discussed in §6 
should provide nearly optimal control decisions. 
Some advantage may be gained by considering an 
infinite stage process as in §5, which has the 
effect of eliminating one subscript. These, and 
other matters, will be discussed in a forthcoming 
thesis by M. Aoki, [11]. 


Notice that the adaptive controller dis- £,(c, ,¢,;m,n) = Ie, Jn + lc,s Jn 
cussed in this section does no "research" 
regarding the random variables. It merely 


observes the history of the process to date and Min exp(]c,+c h|+|c is [u(eS-1)e,+c, Ih 
combines this with its a priori knowledge in a + m, <usn m,n i ie e 1 

way which is specified at the beginning of the “Rais 

process, in order to arrive at its current con- Je}<c + (d+g)nhl) 


trol decision. How the controller will act as the 

result of any particular observed history is fully 

specified initially. More sophisticated control- fa GES Jexp(le +ce_h]+lc elite sine +e. ]h 
lers will be designed to look for correlations, m,n ee 2 1 Cai 
provide for non-stationarities in the unknown pro- 

cess, and so on. Much remains to be done along + (ove np). 
these lines. 


(6) 


This case differs mathematically from the 


8. An Extension previous ones only in that the minimizations are 
POT Re ae now over a two-dimensional region rather than a 
Let us now turn our attention to the case in one-dimensional region. 
which the system can be controlled both by modi- 
fying the system parameter wu and also by exerting 9. Discussion 
a control force, &,, at time kh, where 
k = 0,1,2,...,N -1. The equation for the state of In the earlier sections of this paper we have 


sketched a treatment of an adaptive control process 


the system becomes 
from the dynamic programming viewpoint. Much re- 


=x +vh, x,=c., (1) mains to be done at various levels in the treatment 
n+l n n ie) it of these fascinating control processes. 
2 
atria aes a [uO + 1)v,, 4 x, fn + rh+ eh, At the conceptual level, for example, models 
involving other types of uncertainties on the part 
"Gao? of the controller, mentioned in §1, have yet to be 
constructed. One of the principal difficulties 
where now both p, and g are at our disposal. As occurs in describing the state of knowledge of the 
before, y is limited to lie within the region controller and how this changes as new information 
is added. Furthermore, so much information may 
m SHSM, n= 0, 1,.-.-,N-1, (2) become available that a way must be found to 
summarize it succinctly without impairing the 
and we shall also assume that the control force decision-making capability to a marked degree. In 
gis constrained by the inequality this connection, see the discussion of sufficient 
statistics in [14]. 
fe-|go0G, nu = 0,1,2,...N — 1. (3) 
Insofar as the mathematical analysis itself is 
Upon introduction of the functions concerned, many perplexing problems arise, as, for 
f,.(x,v3m,n), example, questions concerning the convergence of 


discrete adaptive processes to continuous processes 

N-1 and the very formulation of adaptive processes of 
3 s continuous type. 
£,.(c, .¢53m,n) Se oMin. CR} &; (] x5] +Iv, [5 yP 


<m, Lj=N-k 
eS 2 Lastly, as we have already indicated, for the 


lg,|< (4) more realistic processes involving more state 
variables, the computational solutions present 
me exp([x,|+ [val ) ? special problems of their own, all of which must 


be carefully investigated. 
for k = 1,2,...,N, we find that the relevant 


functional equations are Another whole problem area beyond those already 
f,(c,,¢,3m,n) = |c |h+ fe [n (5) mentioned is encompassed by the actual construction 
de et ik 2 of optimal adaptive controllers. Challenging 


2 problems arise in trying to pursue a straight and 
+ Min Pa nfke1(er*ahsta-|a(cq-Lepte h narrow path between the complexity of exact 
m, $<n,, solutions and the fallibility of approximations. 
jel 
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Summary 


In many multi-stage decision processes we 
face the problem of dealing with random variables 
whose distributions are initially imperfectly known, 
but which become known with increasing accuracy 
as the process continues. In this paper we shall 
show how Dynamic Programming~ may be used to 
treat a class of such problems,which are current- 
ly called adaptive processes. 

After discussing the general theory, we shall 
illustrate the techniques by a specific example. For 
this example we derive simple computational al- 
gorithms, which are typical of those obtained for 
the whole class of problems under consideration. 


1. Introduction 


A large class of control problems concerns 
systems which can be described at anytime tbya 
real s-dimensional state vector, x(t), obeying a 
linear differential equation 

x(t) + A(t) x(t) =y(t) (1) 
Here y(t) is a real s-dimensional control vector, 
and A(t) is a known s x s matrix function of time. 
We are given the initial state 

x(O)=c , (2) 
and are asked to choose y(t) so as to minimize the 
error functional 


Au 


Gy) =2} (et, y(t), r(t), vat, (3) 
0 


where r(t) is an s-dimensional stochastic process, 
and g is a given function. 


* The work reported here was performed at Lin- 
coln Laboratory, a technicalcenter operated by 
Massachusetts Institute of Technology with the 

joint support of the Army, Navy and Air Force. 
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2. Discrete Formulation 


This problem becomes particularly interest- 
ing when the statistical properties of the stochastic 
process r(t) are incompletely known. For this pur- 
pose, the continuous version described above is 
rather cumbersome. Instead, we shall suppose 
that time is measured discretely, and that at any 
time n we have x(n), y(n), andr(n), analogous to 
x(t), y(t), and r(t) above. The control equation 
may now be written as 

5 (1a) = 


A(n)x(n-1)+ y(n) , (4) 


the initial condition as 
x(O)=c , (5) 


and the error functional to be minimized as 


Mz 


Gy(y) = Ba), ya), eto), mh (6) 


1375 Jt 


In many processes time is measured most 
naturally indiscrete periods, so that the continuous 
process described by equation (1)is only a mathe - 
matical idealization. For such a descrete process, 
equation (4) is more suitable. 

A further advantage to be found in using the 
discrete formulation is that the solution appears 
as a set of recurrence formulas. These are ideal- 
ly suited for automatic programming by a digital 
computer. 


3. The Stochastic Process r(n) 


We must now clarify what we mean bya sto- 
chastic process with imperfectly known distribu- 
tion. There are several ways to do this, but we 
shall consider just one. 

We shall assume that r(n) is a stationary 
Markov chain, of some order v. (The simplest 
case is y=0, where the r(n) are independent) . 
We suppose that we know the transition probabil- 
ities in terms of certain unknown but fixed para- 
meters, and that we have an a priori distribution 
for the values of parameters. As the process pro- 
ceeds, we observe r(1), r(2),...,r(m) andsumma- 


rize them by a sufficient statistic S(m). Using S(m) 
and the a priori distribution, we compute an a pos- 
teriori distribution for the unknown parameters, 
and this gives us an up-to-date distribution to use 
for r(m+1). 

We can show that the a posteriori distribu - 
tions for the unknown parameters will converge,with 
probability one, to the true values of these para - 
meters. At the same time, the up-to-date distribu- 
tion for the r's will converge to the true distribution. 

The following examples should serve to clar- 
ify the concept of a sufficient statistic. 

Example 1:(v=0). Suppose that r(n) is a sequence 
of independent, identically distributed Gaussian ran- 


dom variables, with mean 0 and unknown variance 


iz, wees : P 
o . Let us also assume that the priori distribution 


is a y-distribution on 1/o%, y(1/o4;a, b), so that the 
density function for o is 


b 
-2 a 1 a 
nio= = ey oe 5) odo 7 
o> P(b) o2 o = 
where a and b are given positive numbers. Then 
m 
2 
S(m) = > r(n) (8) 
n=1 


is a suitable sufficient statistic, since it enables us 
to compute the a posteriori density 


1 
b+5m 
z 2+7S(m) | a 
p (o)= 
aa o 1 
[- (b+5m) 
a+s(m) 
] a 
vse ( Fone eae ; (9) 
2(b+>m-]) o 


l 1 1 
which gives the y-distribution ( 7, at>S(m), b++m) 


for Le It is this reproductive property which led 
o 
us to use an a priori y-distribution. : 
To find the distribution of r(m+1) we multiply 


y._(c) by the Gaussian distribution and integrate 
m 


over o. Doing this, we obtain the up-to-date density 
function 


1 
b+ 
l plb+5(m41) [a+dsim)| Bs 


1 
1 1 2}b+5(m+ 1) 
+5S(m)+5r fz 
[: 2 i (10) 
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for r(m+1). If we make the substitution 


2b +m 


penal Baie So (10a) 
Za + S(m) 
we find that this is Student's t-distribution with 
2b + m degrees of freedom. 

It is also important to be able t@ calculate 
S(m +1) from S(m) and r(m+ 1). This is readily 
done using the formula 


S(m+1) =S(m) + r(m#1l) . (11) 


Example 2:(v=1). Suppose that r(n) is a first 
order Markov chain of 0-1 random variables. If 
in{forsi la dha eke 8) and 1-6, be the probabilities of 
r(n)=1 and r(n) =0, while if r(n-1) =0 let 89 and 
1-6) be the respective probabilities of 1 and 0. 


We take 8 and 8, as having independent 6 -distri- 


butions, so that the a priori density is 


9 ao) ee 5 ae 9 o-li@ a 
RGgE 0 0 1 1 
Oz 1] = (ee yer ALE IS oe ee ae ee 


B(a, b) B(c, d) 


(12) 
where a, b, c, and d are arbitrary positive num- 
bers. 
Let m(i, j) be the number of pairs(r(n-1)=i, 
r(n)=jfobserved for n=1,2,...,m. Thenas a 
sufficient statistic we can take the vector 


S(m)= (m(0, 0), m(0,1),m(1,0),m(1,1)). — (13) 


The a posteriori distribution is 


9 uml O.L) le yt (03.0) <4 
tis, (00) ° 
B(at+ m(0, 1), b + m(0, 0)) 
gnetealls oY pep ee melr Olek 


(14) 
B(c+m/(l1, 1), d+m/(1, 0) 


In this simple case we can compute the 
expected values of 95 and 8) with respect to 


Hy (8q: 91)» 


and use the appropriate one as the probability of 
r(m+1)=1. We find that these expected values are 


+m(0, 1 
e{o,- at m(0, 1) 
a+ b+m(0) 


e{o,\- c+mi(1, 1) : 
Crdict mit) 


(15) 


where m(0) =m(0, 0)+ m(0, 1) is the number of r(n) 
which equal 0; n=1,2>....,im, and similarly for 
mela (LO) aay) 

In order to obtain S(m+1) from S(m) we need 
both r(m+1) and r(m). But we already needed r(m) 


to determine whether 85 or 8) should be used for 


r(m+1), so this is no additional burden. 
Thus we should use 
S(m)=(m(0, 0), m(0, 1), m(1,0),m(1, 1)r(m)). (13') 
The formula for S(m+1) in terms of S(m) and r(m+]l) 
is then readily obtained. 


4. The Functional Equation 


At time m knowledge of the state variable 
z=(x(m-1), S(m-1)) completely specifies the (16) 
current status of the problem. If y(m) is our choice 
of control vector, then the new state variable is 
given by 


(17) 


where x(m) is computed by equation (4), and S(m) 
is computed by a suitable equation (such as (1l)). 
Note that at time m z is deterministic, but that 
(z) is a random variable. 
y(m) 


Knowing y(m) and z we can also compute the 
expected value of the immediate error, 


etm) 4 Efe te(m), y(n), savas s)} 


where the expectation is with respect to the up-to- 
date distribution for r(m) (e.g. (10) or (15)). 

Thus, knowledge of z and choice of y(m) lead 
to an expected immediate error of g(m), and atrans- 
formed state variable a an) (z). 


Now let fn!?) be the minimum expected loss 


T 


(18) 


achievable, starting at time m and with state var- 
iable z. We may write 


min 


Eferoiny, y(n)r(n), a} . 
(19) 


se 9 (Gas 
m 

SAE IS coo a UNS) Geee oe! 

We shall apply the Principle of Optimality? of 

Dynamic Programming to obtain a functional equa - 


tion relating f_ with f . Let us rewrite the 
m ragVe el 


right side of equation (19) in the form 
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min E g(x(m), y(m), r(m), m) + min 

y(m) y(m+1),..., y(N) 
N 
»s E{ebe(n), yin), x(a), al] , 

n=m-+1 


and observe that the values of y(m+1),..., y(N) 
which furnished the minimum in equation (19) also 
minimize the second term here. This second 


i ft 
term thus becomes sae beta tak applying de 


inition (19) at time m+1. If we substitute this 
into equation (19) we obtain the functional equa - 
tion 


fn(2) = min Ejg(x(m), y(m),r(m),m)t+f 
y(m) 


(Ty (ny(2)) } 


The problem requires us to compute f,(c) , 
where we have written c instead of (c,S(0)) since 
S(0) contains no information at all. We also need 
the minimizing choice of y(1), y(2),..., y(N), known 
as the optimal policy, but these will arise natur- 
ally in the calculations. 

The problem is solved by noting that 


B{a(<(N), yN).r(N), ND} , 


at 


(20) 


fy (2) = 


min 
y(N) 


for z=(x(N-1), S(N-1)), can be found by differen- 
tial calculus. We then apply the functional equa- 


tion (20) repeatedly, obtaining fy_vin_2ce ty: 


(21) 


5. Quadratic Error Functional 


The solution just obtained involves the recur- 
sive computation of a function of s+ d real var- 
iables, where dis the dimension of each S(n). 
This will generally require far greater computa- 
tional capacity than even the largest digital com- 
puters now possess, 

In order to overcome this difficulty we shall 
specialize g(x(n), y(n), r(n),n) to be a quadratic 
function of the components of x(n), y(n), andr(n). 
We can then show that a) is a quadratic function 


of the components of x(n-1), with coefficients de- 
pending on S(n-1). Simple recurrence relations 
for these coefficients can be obtained from equa- 
tion (20), so that the problem of recursive com- 
putation has been reduced from one of s +d to 
one of d dimensions. 


6. An Illustrative Example 


To illustrate the techniques described in the 
preceeding sections, we shall consider a one - 
dimensional tracking problem. This may be 
thought of as one coordinate of a two- or three- 
dimensional problem, since all effects can be 
seen to be additive. 


‘ Suppose that at time n we are located at the 
point x(n), while our quarry is at r(n). Our motion 
is controlled by the equation 


x(n+1)=x(n)+ y(n+1) (22) 


where y(n) is our control variable. His motion is 
controlled by 

r(n+1)=r(n)+u(n+1) (23) 
where the u's are independent, identically distrib- 
uted Gaussian random variables, with mean 0 and 
unknown variance o%. The a priori distribution for 
o is (=; a,b), whose density function is given by 

o 

equation (7). We shall certainly need 


m 


S)(m) = y Gino 


n=l 


(24) 


as part of our sufficient statistic for determining 
the distribution of r(m+1), since we use this for 
the variance. But we must also find the mean, 
which is given by 


m 
S,(m) =a p28) V— > u(n) - (25) 
n=l 
We can then take 
S(m) =(S,(m), S,(m)) (26) 
The a posteriori distribution of r(m+1) is then 
given by its density function 
b+ 5m 
1 1 
1 F(b+3(m+l) [atzS,(m) | 
eae 
((b+5m) 1 1 5 b+{m+ 1) 
[ats iia ce Sy? | 
(27) 
Finally, the error function is given as 
2 


gc(n), y(n), x(n), n) =a(n)y(n)® + bla) x(n)—u(m)} 
(28) 


where a(n) and b(n) are known, positive functions 
of time. The terms on the right in equation (28) 
may be interpreted as an energy cost for moving 
us about, and a cost for inexact tracking. 

Our problem is to choose y(1), y(2),..., y(N) 
so as to minimize the error functional 
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N 
Gyly) = Y E {a («(n), y(n), x(n), n)} pa (29) 
n=l 
given the initial conditions 


(30) 
As our state variable at time m we take 
Zz =(x(m-1), S(m-1)) (61) 


If we choose y(m) then we get the transformed 
state variable 


eal = (x(m),S(m)) , (32) 
where x(m) is given by equation (22), and 
S(m) = S)(m-1) + u(m)? 
(33) 
S,(m) = S,(m-1) + u(m) 


We can now define f ), the minimum ex- 


(z 
m 
pected loss starting at time m and state variable 
Z, aS in equation (19). We assert that this func- 
tion is a quadratic function of x(m-1l), say 


ax(m-1)"+6x(m-1) + ¥ (34) 


where the coefficients a, B, and y are functions of 
m and S(m-1). If we substitute this expression for 
fn (2) and the corresponding expression for 


io bea Zz), into equation (20) we get 


a(m, S(m-1))x(m-1)* + B(m, S(m-1))x(m-1)+y(m, Stm- 1) 
(2 
= min 


E{a(m)y(m)* + b(m) [x(m)-r(m)] 
y(m) 


#a(m+ 1, S(m)y(ma)-+P(m+ 1, S(m)) x(m) + y(m#l snp} 


(35) 
It is easier to deal with this equation if we replace 
y(m) by x(m)-x(m-1), and choose x(m) so as to 


achieve the minimum. The minimizing choice of 
x(m), found by setting the derivative equal to 0,is 


a(m)x(m -1)+b(m)E r(mn)}-7 [pnt 1, S(m)} 


a(m)+b(m) + Ejfa(m+1, S(m)) 


x(m)= 


(36) 


The expectations in equation (36) are to be taken 
with respect to the a posteriori distribution for 
r(m), given by equation (27). We also note that 
they are abbreviations, e.g., 


E{a(m+l, S(m)} : Bfatmtl, S(m-l)+ (mf, S, (m -1)+r (mi) 


(37) 


If we substitute expression (36) into equa- 
and equate the coefficients of like powers 


we obtain 
a(m)(b(m )+ Efa( m+1,S(m) ae 


a(m) + b(m)+ Bfa(m+ 1,S(m mj 


tion (35), 
of x(m-1), 


a(m, S(m-1)) 


(38) 


m)[E{8(m+1, S(m)} - 2b(m)E x (mf} 
a(m)+b (m) )+ Efa( (m+ 1, S(m)} 


(39) 


6(m, S(m-1))= = 


and 


y(m, S(m-1)) = Efymtl, S(m)} + bon) fren f 


[bomen pe {6 (emt, sm} 


a(m)+b(m) + Eja(m# 1, ey 


Using equation (21) we can also find that 


aN? SIN- 1s SUE) 38") 
a(N)+b(N) 
BIN, S(Ne1) = CS NIBINJE;r(N) an 
a(N)+b(N) 
and ; ’ 
y(N, S(N-1)) = bomefeon)}- b(N)'E}r(N) 
a(N) + b(N) 
(40°) 


We can observe several important facts from 
these equations. First, from equation (38) we see 
that a(N, S(N-1)) does not depend on S(N-1). Work- 
ing backwards, by means of equation (38), we then 
find that for any m,a(m,S(m-1)) does not depend on 
S(m-1). We shail therefore write a(m) in place of 
a(m,S(m-1)). Thus equation (38) becomes 


ieee: a(m){b(m) + a(m+ 1)] ; ‘ali 
a(m) + b(m) +a(m+ 1) 
and similarly for equation (38). 


Secondly, from equations (36), (38), (38 ),(39) 
and (39' ) we see that we do not need the y's. We 
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1 
thus can dispense with equations (40) and (40 ), 
again reducing our workload considerably. 

Finally, computation of the B's from equa- 
tions (39) and (39') is not as difficult as it might 
appear at first. If we study these equations we 
find that the expectations involved are all linear 
in the r's, and that the apparently compound ex- 
pectations reduce to simple ones according to the 
rule that the expectation of a conditional expecta - 
tion is just the unconditional expectation. Thus, in 
equation (39° ) we can put 


Efron) =S,(N-1) , (42) 
since S,(m) is the mean of the distribution hin") 
of r(m+1), (equation (27)). Then 

B(N, S(N-1p= - 220N)PUN)S,(N-1) 

a(N) + b(N) 


(43) 

Now, in using equation (39) at time m=N-1 wecan 
put 

r(N-1)} = S,(N-2) (44) 


and 


2a(N)b(N)E}S,(N-1) 
a(n, S(v-1)} = : PIS SES 


a(N) + b(N) 
2a(N)b(N)S, (N-2) a, 
PO TTS 
since S,(N-1) =r(N-1) by equation (25). This may 


be written as 


E}PIN, S(N- 10g = B(N,S,(N-2). (46) 


If we work our way backwards in time we 
find that at any time m we have 


E4x(m)f = S,(m-1) (47) 


B{p(m+ 1, S(m))} = B(m+ 1,S,(m-1) ‘ (48) 


and 


where 6 is no longer a function of S ) (m- Ait AB ohUE =| 


equation (39) becomes 


a(m)B (m+ 1,8, (m-1 ))-2b(m)S, (m-1)] 


B(m, S,(m-1)) = 
a(m)+b(m)+a(m+ 1) 
(49) 
Similarly, equation (36) can now be written 
as 
a(m)x(m-1) +b(m)S, (m-1)- 58 (m+ 1, $,(m-1) 
x(m) = 


a(m) +b(m) + a(m+1) 
(50) 


1 
Equations (38 ), (41), (43), (49), and (50) 

give us the simple computational algorithm prom- 
ised in the summary. Examining these equations 
we find that we do not need to compute any distri- 
butions at all. This is a basic property of the Dy- 
namic Programming solution of any linear-control, 
quadratic-error process. 
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ON THE OPTIMUM SYNTHESIS OF MULTIPOLE 
CONTROL SYSTEMS IN THE WEINER SENSE * 


H. C. Hsieh and C. T. Leondes 
University of California, Los Angeles 


ABSTRACT 


This paper is concerned with obtaining the 
optimum system in the Weiner sense for the multi- 
pole system shown in Figure 1. Earlier litera- 
turel has shown how to obtain the mean-square 
value of the error when the multipole system 
transfer function has been specified, but thus far 
no published work has shown how to solve the syn- 
thesis problem, in general, for this case. The 
principal reason that this problem has appeared to 
be impossible of analytic solution thus far for 
cross correlation between the inputs is based on 
the fact that the usual variational approach re- 
sults in a set of untractable simultaneous inte- 
gral equations involving many complicated cross 
products of the desired weighting functions and 
the variational functions. 

The synthesis problem for the system of 
Figure 1 is first solved for the case in which 
there is no correlation between the inputs to the 
various terminals. The result for the optimum 
weighting functions in this case is presented in 
equation (2), and the resultant mean-squared 
value of the error is shown in equation (25). 

Following this, the far more complicated case 
of the synthesis problem when the inputs to all 
the various terminals are correlated is considered. 
In this case, a rather unique technique is util- 
ized to avoid the difficulties inherent in the use 
of the usual variational techniques. Through the 
technique utilized in this paper, the usual set of 
untractable simultaneous integral equations is 
completely avoided, and instead a set of ordinary 
algebraic equations results. The set of equations 
for this case is shown in equation (6), and in 
matrix form in equation (65). The resultant solu- 
tion for the optimum physically realizable trans- 
fer functions is shown in equation (77). It is 
also shown, as a check, that the solution for the 
case of correlated inputs reduces to the solution 
obtained for the case of uncorrelated inputs. 

The paper then concludes with an illustrative 
example for the more complicated case of corre- 
lated inputs. The possibilities of applications 
of the results of this paper to such fields as the 
guidance and control of astronautical vehicles, 
military fire control systems, bombing navigation 
systems, process control systems, automatic mill- 
ing machines, air traffic control, nuclear reactor 
control, etc., are fairly evident. 


* This work was done under contract AF)9 (638 )-.38 
with the Air Force Office of Scientific Research. 
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Optinum Multipole Control Systems 
with Uncorrelated Stationary Signals 


and Noises Between Terminals. 


The systems under consideration are linear. 
For a linear system it is possible to superimpose 
the effects produced by any number of inputs. The 
response characteristics of linear systems can be 
represented by the weighting function or the trans- 
fer function. The result of employing either of 
these two methods are equivalent, each having its 
own merits for particular classes of problems. 

The weighting function W(t,7) is the unit 
impulse response of the system. W(t, 7) depends 
upon the observing time t and also upon the time 
at which the impulse is applied. For a system 
describable in terms of ordinary linear. differen- 
tial equations with constant coefficients, the 
unit impulse response depends only upon the inter- 
val between application of the impulse and obser- 
vation of the output. Therefore, for such a sys- 
tem 

w(t,T) =w(4-T) (1) 

As is well known, the usefulness of the 
weighting function lies in the fact that it per- 
mits a convenient representation of system output 
to be made in terms of the corresponding input. 
Thus the output, y(t), of a system can be repre- 
sented in terms of the input, x(t), through the 
equation - 

y (=f W(4-T)K(MAT gy 

By a change of variable, this relationship 
may also be written 


y (é)= fw (+) x (t-TIAT (3) 


If the input to a system is sinusoidal, and 


can be expressed by complex quantity ed » then 
fron equation (3) we have 
co ° iwtr™ wi 
fu (4-7) Jjwt ~yw 
yio=[wme AT=€ Jwie A 
° 
fo) 


Thus it is seen that the output of the system 
differs from the input only by a constant complex 
factor 


Yuur=| wine??? dr 


This quantity Y(jw) is called the frequency- 
response function. If we take the Laplace trans- 
form of W(t) rather than the Fourier transform, 
we shall have 


(5A) 


is (p) (5B) 


co 
=f we 24 
where p is a complex constant. Here Y(p) is 
called the transfer function of the system. 
The miltipole control systems under consider- 
ation can be described by n sets of linear time- 
invariant input-output relations as 


dy (t) i fw.» [S, (4-1) my (£-T] AT 
= ° 
(6) 


> = UF a, ane ‘mm 

where s(t) is the signal or the desired input, and 
n(t) is the noise or the unwanted alae reg Iba 
matrix form, the system configuration is shown in 
Figure l. 

Now, if we let D5 (7 ) be the weighting func- 
tion of an ideal system that accomplishes per- 
fectly the desired task, then the desired output 
z3(t) can be seen to be 


n oo 
Fy(O-D | dD, ( S. (4-1) LT 
pat Ay keen? 


Thus the difference between the actual and desired 
system outputs may be expressed as 


Ch) 


EA =9,69-Z.O-L_ J wy, CI] I Dar 


a (8) 
a J Dy, () Syle- 47 


A diagram of this general problem is given in 
Figure 2 where, for simplicity, the usual matrix 
notation is adopted. The part of the diagram be- 
low the dotted line represents the actual system, 
while the part above the dotted line represents 
the hypothetical ideal system together with com- 
parator for generating the error signal, 

After the error has been generated, our prob- 
lem now is how to choose the weighting functions 
of the actual system so as to minimize some suit- 
able function of the error (performance index). 
This performance index can, of course, take forms 
other than the least mean-squared value €*; for 
example, the quantity | €]- However, the mean- 
squared error criterion in addition to providing a 
good indication of the quality of the system is 
very convenient to analyze mathematically, and 
therefore is most commonly used. 

To formulate the mean-squared error, we first 
replace t and T in equation (8) by (t 1, 71) and 
(to, To), respectively, to obtain the two equa- 
tions 


* The lower limit in this equation can, of course, 
be taken as - ~ to include the nonphysically real- 
izable operation of pure preduction, for example, 
and all subsequent results will follow in like 


manner. 


Wy 


Ci(6)= 2 | We (my [y4-7%) 4 (4 TY 


a > 
5 JD, (%) S, (4-0) ocd, 


€ ‘ es )= y in (9) 

LO Saaee. Ww. (2 )LS,, (t,-G)+r (6-7 )jer 
: 3 -7,) AE 
E J th (%)5 (4x Ta) AE 


BAe 


Ah ah. 


Now we may compute the mathematical expectation of 
the product on both sides of these two equations 


Es) €; (43) a 


fa at co Ree cy och ea eee eee 
e 2 if Wit) der) [s £-T JG -7,)] bs £2 T IM (AT )) 
Wig (TILE 


(10) 


a 


Nie ieee 
: b, \ wna) Be WE TUS Se DD, (eae 


kA 


Cd) $7) SE) Dy (TH) A 


The correlation function between two station- 
ary random processes x(t) and y(t) is expressed by 
means of 


by)> XO GED 


Thus equation (10) may be rewritten in terms of 
autocorrelation fuctions and crosscorrelation 
functions as 


(11) 


n oo ba) 
L&, (w, Aue \d 7, { [ 9s, s, (tx Ait e T+, fattT%) 


a Lng (ta vat dt 0 ae ARNE! (44,1 7-%)) W, ' (73) ele 


nm pe, ie 
‘L - | dk sf van hs, 454,*7,-% + mp taar- %)) 


Th Ake Ks 
2 L j Wy) da \f, Gat TOD, ps1 ees ae )] 
pice Dey (AM, 


(12) 


By setting t , equal to to, we can determine 
the mean-squared value of the error. Thus 


ke Lie (7) 47, CF sp qr (BIG, 5, (Ta) 


S Ps ny, C7; -Ta) +P, Bere) | Wy, (I) AT. 


nw Cn) rc) 


(13) 


n n oe} 0 
le hes Wi) AT SLs, 7B) Gys gr BID A 


a 2, (7, od, J $5 sp, (7-2) De (B)IAG 


Since p xy(T ) = yx(-7), then the above equation 
can be simplified as 


( wy creer Es, ( T -73.) +P, Sper G7, ~Th) 


k=) ki ~o 


fi Ps, ny) (7,-%)+* Pap ng (7,-%)] Wy, (5) At, 


a ne eo (14) 
ab de%y (Syn) 41) Tass (1-E)+ Py ng lt Tad] Wy fad. 


oa 


dy (7) d7, | Ls, sp, (7,-7%) Dy (i) h%, 


Let us introduce for convenience the notation 
hep I=Ps, 547+ Pusp: (7) +P og r¢ OPngng ley 


On pi (T=Psy spr (7) rhs, pe (7) (16) 


Then equation (1) can be rewritten in the form 


—_ n wm a @ 
aon | Wy, AT [YEO My AT 


(7) anf Og (tet) 


Go 

—(Ddt : : 
piensa ey | dd a) Is, spr (7 %) Dy! NT) AT. 

This equation forms the starting point for 
our minimization problem. It gives us a way of 
measuring the mean-squared error value of the out- 
put in terms of the statistical characteristics of 
the input and the response properties of the 
actual and ideal systems. 

Let us now assume that the inputs to all ter- 
minals are uncorrelated with one another. Then 
all the terms in equation (17) with different sub- 
scripts k and k' will drop out. Therefore » equa- 
tion (17) reduces to 


ey Bout We (nm) 27 f A (7-7) Wy te) LI 


oo 


J D, 


k=} 9° 


n 


(T)A7 Je, 7,-E) We, (3)4%. 
(18) 


| $s, sh Ta) Dy (2) L% 


° 


Pyles 


ke 


k 


: J; (%) LT 


' 


(Ta- 7) Wy, (Ta) 4%, 
(18A) 
(7) dt j $s, s, Ta TID, (IA % 


n 
ip 
Rk 


=) 


oo 


Dy, 


° 


where 
D, (7) = Fes, (P ng sp (Mt Py np rg 
(19) 


Cp = Poesy (74 Pigs pe (D 


(20) 


The next step in the argument is to find a neces- 
sary and sufficient condition that Woy (7 ) must 
satisfy in order that €¥ will be a minimum. If 
W5e(t) actually minimizés €} and if we replace 
W3q(t) by W(t) + ayAy(t), where a, is a real 
number and x(t) is an arbitrary function of t, 
the effect will be to increase €%. Thus, for 
fixed functions A,(t), €? will Ve a function of 


Bee t 


C7 (@) Gay) = 


ee j a7, { AT Dwi (714%, 4, (7) Dy (75)44, 4 


Deh (1-7) 


A) J, oda] e, Te Dy (YA (BAT 


eo . oS | i 
oe J Dy toa] Pos sp (73, T) Dey (%) 47 


n oo oo 
Be far J At, [Wy,(7) Wy, (4 )+ Up Ay (7) Wij, 


~ 


+04 Ay a) W; pet % Ay (aA, (27) 


-A re [amar] 6, (TIM, (7.04, A, (GI) 2% 


et ocd is 
ae. Dd. (DAs $5.5 WD (a) AT 


This equation will assume its minimum value 
when 8] = a9 = - - = a, = 0. Therefore, the par- 
tial derivatives of €% with respect to a,'s must 
vanish for a,'s = 0, where k =1, 2, ---n. If 
we differentiate equation (21) with respect to 
a,'s, and then set a,'s = 0, we have 


faz, j aT [A Wy (%)+A (a) WG, (a0 


Ald, Dan / Og (4-7) A, (dE =O (22) 


since Dig (71-72) = Dp x7 2 -7 1), equation 
(22) can be rewritten as 


2 Wy 47) bee (7,-7,) Ay (a) Ah 
ze Dy radrf 6, (tT) AK BAG: 


or. co) 
J Ay all j We (7) Gee (7,-7,) 47, 


00 (23) 
3 § Dj p (7) ek Ma TAT] AT = © 


(23) 


Because this must hold for any function A,(t), 
we finally get 


J Wp (7G le IE7 f Dy (7) ere (%) LG 


or 
fw (7) ¢ (£9 a7=\ dy (7) Oyglt-T) dT 


2.)* 
teehee Oo 
and 
Wey (J=0 foe T LO 
where k = 1, 2, ---n. 


This is the condition which Wie (t) must satisfy in 
order that €% will be a minimum under the un- 
correlated case. This minimum value is according- 


ly equal to a e 


(25) 


J wWymet] lO Wynd 


n 
k=§ 


Solution of Integral Equations 
Using Complex Variable Tec es 
the Uncorrelated Case 


Before we start to solve the integral equa- 
tion (2), there are two important theorems fron 
function theory which we will need in order to get 
the desired solution. 


Theorem I 

f(t) be an integrable function which 
vanishes over the time range from t = -o to 
t = 0, and possesses a Fourier transform F(w). 
Then 


0 ASu7b co ~fwt 
Fools pe eel Oem 2 en 


is an analytic and bounded function of the complex 
variable w in the lower half of the complex plane. 
Conversely, let F(w) be analytic, bounded, and 
free from poles in the lower half of the complex 
plane. Then if f(t) is the inverse Fourier trans- 
form of F(w) so that 


eo jut 
f(A) =a {e F (we dw oe 


* If we allow Dine 7 ) to be a physically nonrealiz- 
able function, then this equation becomes simply 


i Wy (7) by, , E-AT= { Dy (74 ~E-DAT 


It is also true that f(t) vanishes over the time 
range from t = - ~ tot=0. This same argument 
can be applied to f(t) vanishing over the range 
(O, © ) and F(w) being analytic, bounded and free 
from poles in the upper half of the complex plane. 


Theorem II 
If G(w) is a positive and real-valued func- 
tion defined for real values of w for which 


( [Log |G (w)| | 
dw (28) 


[+wr 
then there exist two functions Gt(w) and G-(w), 
such that 


G(H) =G @&) G () (29) 


is true for all real values of w. Furthermore, 
G*(w) is analytic, bounded, and free from zeros 
and poles in the lower half of the complex plane 
and G-(w) is analytic, bounded, and free from 
zeros and poles in the upper half plane. In other 


words, % 
A = 
5 -[G 12) (30) 


for all real values of w. Here, the asterisk de- 
notes the conjugate quantity. 

With these two theorems in mind we can now 
return to the problem at hand. For convenience 
equation (2h) is rewritten as 


[wa trrgygterd7-f Dp Ee ee 


ee) 


foe ge Pate KE! 


and 
' T = 

W,, ( d=0 foe T LO 
where k = 1, 2, --n. 

If equation (31) holds true for all values of 
t, it can easily be solved by means of Fourier 
transforms, provided that all the functions 
Dix(7), Dre) and © xx (7) possess Fourier 
transforms. However, equation (31) can not be 
treated in this simple way since the left side is 
equal to zero only for t equal to or greater than 
zero, It is evident that in order to fully util- 
ize the Fourier transformation techniques to our 
final solution, certain modifications of equation 
(31) mst be made before taking the transforma- 
tion. This modified equation would then be true 
for all values of t. Finally we transform this 
modified equation to obtain explicit solution of 
weighting function, 

Since the functions Pri(7) and © m(7), in 
general, have non-zero values for negative t, the 
equality of equation (31) is not true for t less 
than zero. Let us define a function §,(t) such 
that 


fa 69 et: mdt-(p. (DG, (t-ndr 
B(O=[ Wel) dea le-7)47-f DDE A? 


(32) 


) 
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Foci tae ag (33) 


and 


fish) =.0 foe £20 h 
After understanding the nature of this function, 
f(t), we can proceed to combine equations (33) 
and (3) into one single equation which holds good 
for all values of t. Thus we have 


I. Wi Y dp (endr-f Do Q, e-DAT=E (é) 
(35) 


ioe. ALL VALUES OF Le 


Now we can freely take the Fourier transfor- 
mation on both sides of this equation since the 
imposed constraint has been removed. The expres- 
sion on the right side of equation (35) is simply 


oo -gwt o -gut are 
Ste de- J $e Atel 


Thus F 5c (w) can only have poles in the lower half 
of the complex w-plane. The first term on the 
left side can be written as 


ee ~fwt co 
J e dt | We (7) byy AeTIAT 


co 


gh Wee cy Gt? fv -joT 
i ee (t-T) dt W (Me ‘iw 


ae (~) Yo, Ge) 


y 


where Gy, is the total power spectral density of 
input k and Y 5 (Jw) is the transfer function. 


¢ 
Gp, wr Gspop (OG rg 4 (w) + 


Gsy np lw) + Grgny (MY) (38) 


The second term on the left side can be treated in 
the same way. 


( et ae J Dy Opp (4-7) AT 


7 (39) 


oc : ~gute-7) ¢ oe a -Fv 
at 6, ere d [ire PE: 


—% 


-17G, (2) ( Ya). (ge) 


(39) 
where .e 
Gag (Y= Gop sy + Grp sy (w) 
oe equation (35) becomes 
6 Con bel bf aw ol 
Gene?) Mp Gp go Vy, G9) =a Fy (40) 


Let us examine the term Gry expressed in equation 
(38). It is known that the auto-correlation func- 
tion of a general stationary random process is an 

even function and can be expressed or approximated 


by the expression Zz Ar eo ¥4lT 


Therefore, auto-power spectrum density is a ra- 
tional function expressible as the ratio of two 
polynomials in w2 with real coefficients. It can 
be shown that its poles and zeros are placed 
symmetrically with respect to both real and ima- 
ginary axes. Furthermore, we observe that since 


ZS) i aw Meee af Bo! ju 
Gspngl- j= aT. [Anime i 
we have e < Re 
Gry (-w*) “| An (Ve td 


= Gs, ng ims) (421A) 


Thus, the zeros and poles of Gs;.n,(w) are symmet- 
Tically placed about the imaginary axis. This 
same argument can be applied to Gn,s,(w). In 
addition, since 


M Ly fies -gwT 
Gsypn,(H) = TF {Fan Su we 
oe” . -7) 
=F [ bys, et AT 


oe i Prys,(7 cee as 


Zs GasL (wu) 


It follows that zeros and poles of Gsyn,(a) are 
the complex conjugates of those of Gnxsx (w). 
Therefore, the zeros and poles of the function 
Gsyny(w) + Gnys,(w) are also located symmetrically 
about both the real and imaginary axes. Finally, 
the function G*;(w) has zeros and poles located 
symmetrically with respect to both real and imag- 
inary axes and is a rational function of we, 
Therefore, G%k(w) will meet the requirement of 
Theorem II and can be factored into two functions 
in the form 


QF = GG) 


21 


where G*y,.(w) and G-,(w) satisfy the following 
conditions: 

1. The zeros and poles of Gtr, (w) lie en- 
tirely in the upper half plane and coincide with 
the zeros and poles of Ga (w) there. 

Be Gm (w) has complementary properties. 
Substituting equation (2) into equation (0), we 
shall have 


+ = S ae = 
Gee Sew Gh Gee Wh) =F Ry: 
or 6 = 
+ Gre lV¥iie 11 Ere 
Gee Yp= Cue the! ees) 


A ke 
Here, for simplicity, the argument w is omitted, 
and Y4, and (Yd}}, are expressed in terms of w rathe 
than jw. 

Since Ys, is a physically realizable function, 
its poles and zeros are symmetrically placed about 
the imaginary axis with no poles in the lower half 
of w-plane., Hence the left side of equation (43) 
can only have poles in the upper half plane. The 
first term on the right side can have poles over 
the entire plane, but the second term only pos- 
sesses poles in the lower half plane. Thus we 
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Here the symbol 7’ means the total upper half 
plane poles of the function Gy, (Wy 
Gags th 
If this function is a rational fonckion, the pro- 
cedure for obtaining its poles in the upper half 
plane is rather simple. All that we must do is to 
expand it in partial fractions and throw away all 


the terms having poles in the lower half plane. 
If it is not rational, we may use the equation 
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This time function h(t) has non-zero values for 
both positive and negative time. By taking the 
Fourier transform of h(t) over the positive time 
interval only, we shall get all its poles in the 
upper half plane. 

Thus, for the uncorrelated case, equation 
(4) can be used to determine all the system 
transfer functions directly and independently. 
With system having n-inputs and m-outputs, there 
are mmequations of this type. In frequency 
domain, the minimum mean-squared error can be ex- 
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General Consideration for the Optimum 
Multipole Control Systems when Signals 


and Noises are Correlated. 


In this section, the most general case for 
correlated signals and noises will be considered. 
They are restricted to stationary processes as in 
the previous sections. From equation (17), the 
seg ie error is given as 
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where Dia: ' and & kk' are defined equations (15) 


and (16) respectively. 
Due to the presence of crosscorrelation func- 
be ee their associated weighting functions 
Wa,(77) and We" (1 9 ) are tied together, as in 
the first term of ebastied (48). Here the two 
subscripts k and k' can assume different values. 
Therefore, the situation becomes somewhat more 


complicated when compared to the uncorrelated case. 


The usual techniques of the calculus of variation 
camnot be applied here. 
In order to solve this problem, let us define 
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where Vs,(7 ) is an unknown eine function. 
Substit tae this equation into equation (8) 
oes peorurts 
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By adding and subtracting a term 


Hi: a j y,(147, Pep (7, - 7) Vi, (7a) dh, 


the above equation assumes a very useful form 
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It is very evident that the last four terms can be 
grouped Srié to get 
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The last terms in this expression may be 
written as 
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which shows the fact that this term is always 
positive. Therefore, to minimize the above equa- 
tion, we can obviously choose 
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Under this condition, the minimum minimm mean- 
tes) Brats is 
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Equation (53) gives not only the necessary 
condition but also the sufficient one. The reason 
is that the functions V4,'s defined in equation 
(49) are expressed in terms of all the known quan- 
tities. Therefore, the minimm mean-square error 
given in equation (5) is not affected by the 
choice of the system weighting functions. The 
determination of these optimum weighting functions 
is thus unique. 

By combining equations (9) and (53), we have 
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x(t) = 0 for t<0O. These are the integral 
ons which W351 (t) must satisfy in order that 
; will be a minimum. 
In frequency domain, the minimum mean-square 
error is equal to 
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Here the transfer functions Y.4,'s we look for mst 
be such that the integration of second summation 
terms is finite. This condition can fie met 

each of the fractional functions Ya” Yc’ & Lae 
has denominator with greater power than its numer- 
ator. 


Solution of Integral Equations 
for the Correlated Case 


The techniques used to solve integral equa- 
tions for the correlated case are somewhat the 
same as those for the uncorrelated case. Let us 
consider the fact that the ideal weighting func- 
tions can be physically unrealizable. Equation 
(554) can then be rewritten as 
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and W: 5x (t) = 0 for t<0, where k' = 1, 2, --n, 
The equality of this equation also holds good only 
for To equal to or greater than zero. Therefore, 
a ae ae Pe can be defined such that 
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Combining equations (58) and (59), we shall get a 
single equation which is true for all values of 7o. 
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Taking the Fourier transformation on both sides of 
this ua we obtain 
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Here Fog! can only possess poles in the lower half 
Gh and 
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Thus we have reduced the final solution of 
our problem to the solution of a set of linear al- 
gebraic equations. For each pair of input-output 
terminals, there are n equations of this type. 
Hence unique explicit solutions for the n transfer 
functions associated with a particular terminals- 
pair can be obtained. m-groups of this type of 
equations will give the complete solution for the 
total m x n transfer functions. 

Let us write down all the n equations for j 
terminals-pair as follows: 
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In matrix notation 
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The desired system transfer functions can then be 
expressed as 
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pe us examine the elements in the determin- 
ant G. Along the diagonal with both subscripts 
in same, we have 
Gy = Gs Gry F954 nh" Gry nfX70) 
It has been shown in the uncorrelated case that 
this function Gy, shall be a rational function of 
we and its poles som zeros are located synmetri- 
cally with respect to both real and imaginary axes, 
The terms G','; located symmetrically with respect 


to the diagonal are complex conjugates. Hence 
equation (67) can be rewritten as 
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Therefore it is a Hermitian determinant. We shall 


limit ourselves to the case that G does not have 
zeros on the real axis. It would be true for most 
of the problems we are interested Ane Therefore, 

G shall be a rational function of we and shall 
have poles and zeros placed symmetrically with res- 
pect to both real and imaginary axes. It is pos- 
sible then to factor G into two functions in the 


form 
Gw) = G&) G 


where Gt(w) and G-(w) satisfy the following 


(72) 


conditions: 

1. The zeros and poles of Gt(w) lie entirely 
in the upper half plane and coincide with the 
zeros and poles of G(w) there. 

2. G-(w) has complementary properties. 

Substituting equation (72) into equation (69) 
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Since Y 5k is a physically realizable transfer 
function, it cannot have any pole in the lower 
half plane. Hence the left side of equation (73) 
can only possess poles in the upper half plane. 
The right side of equation (73) can have poles 
over the entire w-plane. Our problem now is to 
single out all the poles which are in the upper 
half plane from the two summation terms. 

All the quantities oa eh in the first 
summation terms_— A N° are known. 

kk dk! 

this whole function Ss a rational function, the 
procedure for obtaining its poles in the upper 
half plane is simply to expand it in partial frac- 
tions and throw away all the terms having poles in 
the lower half plane. If it is not rational, we 
ae 5 use the soln eS 
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This time function g(t) has non-zero values for 
both positive and negative time. By taking the 
Fourier transform of g(t) over the positive time 
interval only, we shall get all its poles in the 
upper half plane. 

The second summation terms cannot be handled 
so easily. However, there are three things we do 
know. First, the poles of F~+,' are entirely in 
the lower half plane and are not known at the 
present time. Second, the cofactor A,', shall 
have poles over the entire plane and these poles 
are completely known. Third, the zeros and poles 
of G~ are confined to the lower half plane and 
they are also completely known, Therefore, it is 
possible to separate the second summation terms 
rhe two, vs such that 
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P~ = A function whose poles consist of the 
poles of F4,, the lower-half plane poles 
of Ay,' and the zeros of G™, and are 
entirely in the lower half plane. 
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Y< = The upper-half plane poles of Ay',. 
These poles are completely known and can 
appear in multiplicity. 

Hence, by combining equations (73), (74) and (76) 
we shall have 
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It is evident that, if the inputs between termin- 
als are not correlated, equation (77) can readily 
be reduced to equation (h)). 

We have thus expressed Y; jk in an explicit 
form. Everything is known ae that equation except 
the coefficients Cy,'s which still need to be de- 
termined. Here we must be cautious that the trans- 
fer functions Y's we solve for will meet the 
ane thee the second summation terms 
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in he eres My are finite. The determination of 
the coefficients C;1's can be achieved by substi- 
tuting all these transfer functions into any one 
of the set of equations given in equation (61) to 
find all the poles in the upper half plane. We 
shall 5m) 
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From this equation we shall nat a set of linear 
algebraic equations in terms of these coefficients. 
Therefore, unique values for C;,'s can be deter- 
mined. This procedure will be amplified by the 
example shown in Appendix A. 

In conclusion, the synthesis procedure for 
determining the optimum transfer function Y5k can 
be outlined as follows: 

1. Factor the function G(w) into two func- 
tions Gt(w) and G7(w). 

2. Take out all the upper-half-plane poles 
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and determine all the residues (or coefficients) 
associated with each pole. 

3. Add all the upper-half-plane poles from 
Ay', with unknown residues to the expression ob- 
tained in step #2. 

lh. Divide the result from step #3 by G*(w) 
to get the total expression for Y4(w). 

5. Determine the unknown coefficients by 
substituting all the transfer functions thus ob- 
tained into one of the original system equations 
and expanding both sides of that equation into 
partial fractions. 

It will be evident that, in general, the poles 
of the transfer functions consist of two parts. 
First, all the system transfer functions shall have 
poles which are the zeros of G*(w). These poles 
are completely different from the upper-half-plane 
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poles in the individual power spectral densities. 
Secondly, the transfer functions associated with a 
particular output terminal may contain the upper- 
half-plane poles from the desired transfer func- 
tions (Yd), if these poles do nto appear in the 
power enectnal densities, Under very special 
occasions when part of the zeros and poles in the 
function G+(w) is cancelled, the system transfer 
functions shall also contain these cancelled zeros 
as their poles. 


APPENDIX A 


Example for the Synthesis of Optimum 
Multipole Control Systems 
with Stationary Inputs 


As an illustration of the optimalization pro- 
cedures for multipole control system with station- 
ary inputs, let us consider a system with two in- 
puts and two outputs. The spectral densities are 
assumed to be 
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and all the other cross-spectral densities are 


zero, The desired transfer functions of this sys- 
tem are specified as 
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The system configuration is shown in Figure A. 
Let us consider the first output terminal. 
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From oes (67) the determinant G is given 
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Hence we can factor this G function into two terms: 
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In order to obtain poles in the upper half 
plane from this expression we could expand these 
two terms into partial fractions. , Since the first 
term (Y11); contains the factor eJ¥, equations (hh) 
and (75) mist be employed. For the second term 
(Yi1)9, we can just discard all the poles in the 
lower half plane. 
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It is evident that the terms which shall be useful 
in constituting the physically realizable transfer 
function are the first three terms. Hence we have 
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In a similar way we obtain 
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All the coefficients are found to be: 
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(B) Determination of Yyo 
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Following the previous procedure, we get 
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These coefficients are found to be 
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The upper-half-plane poles from Ajo and Ago 
are w,' = j and wo' = j2. Thus we obtain 
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(C) Determination of coefficients 


In order to evaluate the coefficients C11, 
C12, Coz and Coo, let us substitute equations 
(A-9) and (A-19) into the first expression of 
equation (A-1). 
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Applying equation (79), the partial fractions on 
both sides of equation (A-20) with the same poles 
in the upper half plane as denominators must have 
the same coefficients in the mmerators. If there 
is no such pole on the right side of the equation, 
the coefficient of that particular term on the 
left side must be zero. In equation (A-20), there 
are four poles in the upper half plane; namely, 
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It is evident that only the first pole 
appears on both sides of this equation. Through 
the evaluation of the residues of these poles, we 
shall get four independent equations in terms of 
C11, Cy2, Co] and Coo. Thus these constants can 
be uniquely determined. 

The four linear algebraic equations are found 
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Combining equations (A-2) and (A-25), there re- 
sults two simplified independent equations. 
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Tims equations (A-22), (A-23), (A-26) and (A-27) 
can be used to solve for these coefficients. 


C,, = flex 

CprmgorF2e (A-28) 
Can = 40-0595 

Cu = -f 2546 


Finally the transfer function Yj, and Yj2 are 
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The transfer functions Yo] and Yoo can be eval- 
uated in similar manner. 
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Figure 1 


System Diagram 
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Figure A 


Configuration of 2 x 2 Poles System 
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ON ADAPTIVE CONTROL SYSTEMS” 
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Summary 


An attempt is made in the subject paper to 
evolve a basic philosophy for adaptive control 
systems. 


A method is described for determining the sys- 
tem impulse response from measurements of instan- 
taneous system input and output. The impulse re- 
sponse is expanded in a Taylor series, to facili- 
tate solution of the convolution integral. 


From a knowledge of the impulse response and 
the system error, the necessary correction to the 
system forcing function is determined, in a manner 
similar to that used for determination of the im- 
pulse response. 


The techniques developed are applied to two 
systems - one stable and one unstable. Curves of 
the results are presented. 

1. Introduction 

Ever since the earliest feedback control sys- 
tems were conceived and built, the designers of 
such systems have made more and more sophisticated 
attempts, consciously or not, to imitate the be- 
havior of a human operator when he controls the 
process under consideration. The comparator, 
which is common to all feedback systems, is an 
obvious imitation of the human operator comparing 
the actual reading of a measuring instrument with 
the desired reading of that instrument. The out- 
put of the comparator, which is the error in the 
system output, is used to drive the system toward 
the desired operating condition. This is analo- 
gous to the action of the human operator who 
operates the system control mechanism in a direc- 
tion and magnitude corresponding to the system 
error. The anticipating ability of the human 
being is imitated by the control system designer, 
when he makes use of a proportional-plus-derivative 
controller. 


A human being is capable of operating an 
automobile under varying road conditions at a wide 
range of speeds. This range of variation of oper- 
ating conditions results in widely differing dy- 
namic behavior of the automoblle, and in widely 
differing control requirements, as the operating 
conditions change. This places upon the operator 
the requirement of changing his control action as 
the operating conditions vary. 


*this material is being submitted in partial 
fulfillment of the requirements for the degree of 
Doctor of Blectrical Engineering at the Polytech- 
nic Institute of Brooklyn. 
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' automobile. 


It is the purpose of the present paper to de- 
velop a technique for designing control systems 
which imitate this characteristic of the human 
being. This class of control systems will be 
called adaptive control systems; where the term 
Yadaptive'' has been borrowed from the biological 
sciences. The biologist calls a system adaptive 
when its behavior patterns are adjustable depend- 
ing upon changes in system environment. Many 
examples of NN Sets adaptive systems are de- 
scribed by Ashby. 


A familiar example of a system where a human 
being applies his adaptability is an automobile. 
As the velocity of the vehicle and the condition 
of the road change, the operator must vary the 
controls in a different manner, in order to achieve 
desirable performance. The operator senses the 
characteristics of the automobile from the signals 
which he applies, and from the various velocity 
and acceleration components which exist when there 
are frequent changes of direction, as on a winding 
road. When an automobile is driven on a long . 
stretch of straight road, no changes of direction, 
and, consequently, no accelerations occur. The 
operator then receives insufficient information 
about the control characteristics of the auto- 
mobile. Under such circumstances, the normal 
operator keeps the steering wheel in constant 
small-amplitude motion, in order to have continu- 
ous information about the characteristics of the 
Similar small-amplitude motions of 
the control stick have been observed* in studies 
of pilots of jet aircraft. In both of these 
cases, the human operator determines the system 
characteristics from the system forcing functions 
and system responses, and adapts his control 
manipulations in such a manner that the vehicle 
behaves in a desirable manner. 


The field of adaptive control systems is 
very young, and no generally accepted definition 
of such systems exists. It is therefore necessary 
to establish a clear definition of adaptive sys- 
tems, which will be applicable to the control 
systems to be described in the following pages. 
The term, adaptive, will be applied to any con- 
trol system which behaves in a manner similar to 
the jet-pilot and the automobile operator as de- 
scribed above. Specifically it will be applied 
to any control system which continuously, or 
intermittently, measures the impulse response, 
or some other function which characterizes the 
system; and which makes use of this system 
characteristic function to determine, and to 
generate, the necessary forcing function to cause 
the system to behave in a desired manner. 


The next section (2) is devoted to the devel- 
opment of a basic philosophy for adaptive control 
systems, In subsequent sections, a specific tech- 
nique is developed for the implementation of this 
philosophy. 


2. A Basic Philosophy for 


Adaptive Control Systems 


The adaptive control system must perform two 
major tasks: 


1. The system impulse response, or some other 
system characterization, must be determined from 
measurements of the system forcing function and 
the system response. This part of the control 
problem will be called the Identification Problem. 


2. The forcing function which is required 
to obtain a desirable system behavior must be de- 
termined from the system characterization. This 
part of the control problem will be called the 
Excitation Problem, 


The configuration of the systems under con- 
sideration here is shown in fig. 1. The controller 
includes devices to measure system forcing func- 
tion and system response; a computer, to determine 
the characteristic function, and to determine the 
forcing function required; and signal generating 
equipment to generate the required forcing func- 
tion. In addition, the controller will compute 
the desired system response cq(t), from the ref- 
erence input, r(t). Tle desired output, Cq(t), 
may in some cases, be the time derivative of r(t); 
or it may be the response of a reference model 
which is driven by r(t); or it may be some other 
desired function of r(t), as required by the 
specific objectives of the control system under 
consideration. The computer may be composed of 
digital, or analog, or a combination of digital 
and analog components. It does not appear to be 
necessary to restrict the computer to be digital, 
as stated in reference 3. 


The required forcing function, mg(t), may be 
determined from the convolution integral, 


t 

c(t) = S m(X) e(t-t)de . (1) 

-00 
where, 

e4(t) = desired system output 

m(t) = forcing function, m(t), which makes 
o(t) = c(t) 

g(t) = system response to unit impulse 


applied at t = O. 


The integral of Eq. (1) is not valid for non- 
linear or time-varying systems; since g(t) is 
assumed, in this equation, to be linear and time- 
invariant. Adaptive control is not required in 
systems with linear, time-invariant g(t). In 
such systems, g(t) may be measured at the outset 
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of the design investigation, and, based upon these 
measurements, a controller with fixed parameters 
may be designed using conventional feedback theory. 
Systems which are non-linear, or which have time- 
varying parameters, or are both non-linear and 
time-varying, are the types of systems where 
adaptive control appears to offer attractive pos- 
sibilities. The work of succeeding sections is 
based upon equations of the form of Eq. l. In 
order to make this work applicable to time-varying 
systems, it will be assumed that the system char- 
acteristic function and the required forcing func- 
tion will be re-determined periodically, with a 
period which is small compared to parameter drift 
times. Based upon this assumption, parameter var- 
lations will be slow enough that the characteris- 
tic function may be assumed time-invariant through- 
out each measuring interval. This work will also 
be applicable to those non-linear systems whose 
non-linearities may be represented by piecewise- 
linear segments, if signal excursions are limited 
in amplitude. 


In order to make use of Eq. 1, to determine 
mg(t), the system impulse response must be known. 
In systems of interest, however, g(t) is not 
known, a priori, but must be determined from 
measurements made on the system. The impulse re- 
sponse may be determined from a convolution inte- 
gral similar to Eq. 1, namely, 


t 
JS m(%) g(t-T)de (2) 


- 0 


c(t) 


where, 


c(t) = 
m(t) = 


actual system response 


actual system forcing function 


and 2 are both integral equations 
with only a single unknown in each case, m,(t) 
and g(t), respectively. In principle, it is a 
straightforward matter to solve for the unknown; 
however, because of the folding and scanning im- 
plicit in the convolution integral, a solution, 
even for c(t) in Eq. (2) froma knoulpdge of m(t) 
and g(t), is difficult to instrument. 


Equations 1 


Equations 1 and 2 are easily solved ana- 
lytically by applying Laplace transform techniques 
to the equation to transform from the time domain 
to the complex frequency domain, The instrumen- 
tation required to perform this transformation 
experimentally is cumbersome and slow, so that 
this approach will not be considered here for 
application in adaptive control systems. These 
equations must, consequently, be solved in the 
time domain. Since exact solution of these 
equations in the time domain appears to be im- 
possible, a search was made of the literature 
in the field, to uncover any applicable tech- 
niques for obtaining approximate solutions to 
Eqs. 1 and 2. 


Wallman! describes a method originally due 
to Volterra, for approximately solving Eq. 2 by 


making measurements of c(t) and m(t) at N discrete 
instants of time which gives a set of N simultane- 
ous equations for g(t) at these N points. This 
approach is eg ee the one employed by Kal- 
man.3 Aseltine et al,> make use of cross-correla- 
tion between the system output and binary noise 
injected at the input, to obtain the value of g(t) 
at a number of discrete instants of time. Other 
approaches to the Identification Problem are /de- 
scribed in a survey paper by Aseltine et al. 


In the papers by Kaimene and by Aseltine et 
al.,~ the Excitation Problem is solved by varying 
parameters in a network in cascade with the plant 
in such a way that a desirable result is obtained. 


Since the integral equation cannot be solved 
exactly, the Identification Problem must be solved 
by an approximation technique (Kalman) or by a 
perturbation scheme (Aseltine). Although there 
are many cases where the effect of noise injected 
to permit measurement of g(t) is not objectionable, 
the approach considered in the following sections 
employs some approximation technique. Such tech- 
niques are applicable to systems where the intro- 
duction of noise is intolerable, as well as to 
systems where perturbation may be used. It is 
interesting to note that human beings use pertur- 
bation only when necessary, as in the operation of 
an automobile driven on a straight stretch of road. 
When the normal system inputs provideall the re- 
quired data, the human operator does not inject 
noise. In the techniques described in the follow- 
ing sections, it will occasionally be found neces- 
sary to inject a disturbance in order to obtain 
the required data; although during the majority of 
measurement intervals, the required data will be 
obtainable with only the desired forcing function 
exciting the system. The approach used in solving 
the Excitation Problem will, in each case, be 
dictated by the approach used in the solution of 
the Identification Problem. 


For the reasons outlined above, the decision 
was made to use an approximation scheme. The form 
of the approximation which is used must be appro- 
priate to the system being controlled, to the de- 
sired general form of m(t), and to the criterion 
being used to measure satisfactory performance, 
Above all, the approximation scheme must be chosen 
in such a way that the instrumentation of the 
solutions of the Identification Problem and of the 
Excitation Problem is easily and economically 
achievable. 


3. Approximation by 
Maclaurin Series Expansion 


3.1 Introduction 


Solution of the Identification Problem re- 
quires solution of the convolution integral 


t 
J mv) g(t-t)d (2) 


- 00 


c(t) = 
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for g(t) from known values of c(t) and m(t). If 
m(t), g(t), and c(t) are each expandable in a 
Maclaurin series then Eq. 2 may be solved for the 
coefficients of the Maclaurin series expansion of 
g(t) in terms of the coefficients of the series 
for c(t), and the coefficients of the series for 
m(t). The coefficients of the series for m(t) and 
c(t) are easily determined from measurements of 
m(t) and c(t), and their derivatives of various 
orders. 


The infinite lower limit of integration in 
Eq. 2 indicates a necessity for an infinite memory 
to store past values of m(t), or at least a memory 
which has a large enough capacity to store values 
of m(t) for times which are large compared to the 
significant system time constants. In order to 
eliminate the requirement of a large capacity 
memory, some technique must be developed for elin- 
inating the effect upon c(t) of past excitation. 


Since the system parameters are assumed to 
vary with time, g(t) must be computed periodically, 
in order to detect any changes which occur. The 
measurement period, T, must be chosen to be a 
compromise between two sets of contradictory re- 
quirements. The value of T must be chosen small 
enough that the system parameters may be assumed 
invariant in any interval of length T. In addi- 
tion, the smaller the value of T, the fewer terms 
of the series are required to adequately approxi- 
mate the functions m(t), c(t) and g(t). On the 
other hand, as the value of T is made smaller, the 
measurement problems become more severe. In par- 
ticular, the measurement of time derivatives be- 
comes more and more difficult in the presence of 
noise, as the measurement interval becomes smaller 
and smaller. The extent of the difficulty in 
choosing a satisfactory value of T depends upon 
the specifications of the system in each case. 


In the remainder of this section techniques are 
developed for solving the Identification and 
Excitation Problems without requiring a large 
capacity memory by using Maclaurin series expan- 
sions of m(t), c(t), and g(t). The paper is con- 
cluded with two examples illustrating the technique. 


3.2 Solution of the Identification Problem 
Using Maclaurin Series Expansion 


In this section, time reference t = O will be 
chosen at the beginning of the control interval of 
interest. In general, because the series expan- 
sions of c(t), m(t), and g(t) must be terminated 
in a finite (and usually small) number of terms, 
the applied forcing functions will not be exactly 
the value needed to force the system output, c(t), 
to be equal to the desired system output, ¢y(t). 
It is, therefore, necessary to add a correction, 
dm(t), to the system forcing function at t = 0, in 
order to force the output to approximate the de- 
sired output for t>0O. The system forcing function 
may be written as 


m(t) = m, (+) + dm(t), for t 20 (3) 


where, 


m,(t) = system forcing function before cor- 
rection 


dm(t) = correction applied at t = 0 
For t<0, m(t) = m(t); i.e., am(t) = 0, for t<0, 


Description of mt), for t20, in terms of 
the two components, m,(t) and dm(t), permits solu- 
tion of the Identification Problem without any re- 
quirement for a large capacity memory. If Eq. 3 
is inserted in Eq. 2, c(t) becomes 


. t 
elt) = m(%) g(t-t)dv + / Am(t) g(t-t)dv 
-@ ie} 


(4) 
= c,(t) + c(t) 
where 
t 
e(t) = / m,(%) g(t-v)dv (5) 
-© 
t 
eo(t) = S dmx) e(t-t)dx (6) 
0 


Because Am(t) = O for t<0, solution of Eq. 6 
does not require a large capacity memory as do 
Eqs. 2 and 5. For this reason, attention will be 
concentrated on Eq. 6. It is important to realize 
that before Eq. 6 may be utilized, c,(t) must be 
removed from e{t), to obtain Co(t)- 


The Maclaurin series expansion of cp (t) for 
+70 is 


2 
t 
c,(t) = O59 * Coqt + Cop ay + -— 
ae (7) 
t 
e AE Con nt 
n=0 
where 
r 
aie d c,(t) No 
er re 2 + 
dt t<0 
+ 
From Eq. hj, 
ep(t) = c(t) - c(t) (8) 
At the instant t = 0,, Eq. 8 becomes 
(9) 


c,(0,) ; C50 ir c(0,) = cy (0,) 


Since Am(t) is the change in m(t) occurring for 
t20, the forcing function m, (+t) is continuous at 
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t = O, and, therefore, c,(t) is continuous at 


tire O dee. 5 

© (0_) = ¢4(0,) (10) 
But 

c(t) = c(t) ; for t <0 
the refore 

c,(0_) = o(0_) (11) 
If Eqs. 10 and 11 are inserted in Eq. 9, c,(0 ) 
becomes - 

e9(0,) = £(0,) = o(0_) (12) 
By similar reasoning, 
obo ) eich oo ) - e(T)(0 ), Tes 

3 


for all r20O 


Equation 13 indicates that it is possible to com- 
pute the coefficients of the Maclaurin series ex- 
pansion of co(t) by making measurements of the 
derivatives of c(t) just before and just after the 
instant t = 0; i.e., just before and just after 
the application of the correction, Am(t). In Eq. 
13, the continuity of the stored energy component 
of the output is employed to eliminate the effect 
of stored energy on the output, thus eliminating 
the necessity for a large capacity memory. 


The system characterization to be used here 
in the solution of the Identification Problem is 
the Maclaurin series expansion of the system im- 


pulse response g(t), that is 
fo) 
2 n 
t = me 
g(t) bey G + Git + G, or +f es— = Sa a. n! (14) 


This expansion is useful since, for small t, only 
a few terms are required for a good approximation 
to g(t). 


With respect to m(t), it is desirable to 
choose its form to correspond to that of g(t), in 


order to simplify the solution of Eq. 6. The form 
of m(t) to be used here is 
+2 
m(t) = My + Myt + My oy + --ns for t>0 (15) 
Similarly 
42 
dm(t) = OM tip(t) + AMy + OM,t + OM, sr + --; 
(16) 


for t 20O,where H(t) = unit impulse applied 
at t = 0 


The impulse is added to Am(t) in order to increase 
the flexibility of the corrective action. 


Substitution of Eqs. 1) and 16 in Eq. 6 re- 
sults in an integrand which is easily integrable 
term by term. If this integration is carried out, 
c,(t) becomes 


c,(t) = AM Go + (4M_,G 


yh + SMG 


1 ot + 


(17) 


+2 
SSO ACL aie pa ela at ee 
Equations 7 and 17 both express co(t) in a power 
series expansion. In order for these equations 
to be equal for all t, the coefficients of like 
powers of t in both series must be equal. This 
equation of coefficients gives a set of relation- 
ships 


+ (OM_4¢ + AM, 


2 


C,, = 4M ,G 


20 -1°0 


= SM .G, + AMG 


-11 0-0 ( 


21 


= OM 


1S + SMG, + AMG 


10 


Equations 18 may be solved for Go» G,> Gos etc. 


20 


(19) 


Coo = SMG, - bM)G, 


2 oH, 


general 


- bu,2 | 


--+AM_ ,G,+4M_ 4G 
r- 


AMG ro oe eer ZO 


AM} 
for all r 21, where \M_) #0 


If AM.j = 0, Eqs. 19 become indeterminate. 
In fact, in a practical computer, there is a non- 


zero value of the magnitude of AM_} below which the 


operation of division indicated in Eqs. 19 cannot 
be carried out. In order to evaluate the coeffi- 
cients of g(t) under these circumstances, SM.] may 
be made zero in Eqs. 18. Solution of Eqs. 18 for 
Go» G5 etc. in this case yields the relations 
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(20) 


' C4 - (am,G, + AMG) 
2 BM 


and, in general, 


G 


‘ C (ret) EMO p arty ot -- Bae ah Bir 


AMy 
for all r21 , where 4M, #0 


The correction Am(t) is chosen to make 
c(t) = cg(t). It is, therefore, conceivable that 
a control situation may arise in which the first 
p coefficients of Am(t) are required to be zero, 
but the (p+1) coefficient is different from zero, 
If the results of Eqs. 19 and 20 are generalized 
to the case where the first p coefficients of 


Am(t) are zero, the coefficients Go» G,> Gos etc., 
become 
Gee erie 
(@) eT 
G) = ee (21) 
p-1 
ne 222kBt2) = lan, Maio | 
pat AM p-1 


and, in general, 


ee &( ptr). lowo,_+0m,, 1%,_ oe oe Mit, Pol 
4 


5¢ ne 


for all r 21; where JM) = AM, pranh _520 butaM, > Y? 


The general form of the aie Se for o. is the aame 
in Eqs. 21 as it is in Eqs. 19 and 20, so that it 
is a simple matter to program the computer to use 
the set of Eqs. 21 which is appropriate to the 
value of p. 


3.3. Solution of the Excitation Problem 
Using Maclaurin Series Expansion 


The form of Am(t) was specified in Eq. 16, 
in such a way that the Identification Problem was 
solved relatively easily. The determination of 
the appropriate values for the coefficients of the 
series expansion of Amt) still remains to be con- 
sidered. These coefficients must be chosen in 
such a way that the actual output, c(t), closely 
approximates the desired output c4(t). 


As before, direct use of Eq. h requires a large 
capacity memory, which is undesirable. Using Eq. 
4 as a starting point, it is possible to compute 
the coefficients of the series expansion of Am(t) 
an a manner similar to that described in Section 
3.2 for the computation of the coefficients of the 
series expansion of g(t). 


The output error, e(t), is defined as the 
difference between c(t) and c(t), that is 


e(t) = c(t) - c(t) (22) 


The correction, Am(t), was defined in Section 3.2 
as the correction to be made in m(t) to force 
c(t) = cg(t), for t20. Therefore, the required 
forcing function, m (+t) is 


m,(t) = m,(t) + Am(t), for t20 (23) 


and inserting Eq. 23 in Eq. l 
t t 
c(t) = Lom (Te(t-P)dt + He bm(%)g( t-t)d% (2h) 


But, from Eq. , the actual output, in the absence 
of the correction (i.e., Am(t) = 0), is 


t 
e(t)= Sf m(t) e(t-t)de (25) 
-0O 
From Eqs. 2h and 25, Eq. 22 becomes 
t 
a(t) = fet) e(t- )d (26) 


It is now possible to solve Eq. 26 for the coeffi- 
cients of the series for Am(t) in exactly the 


manner that the coefficients of g(t) are determined 


from Eq. Ss 
When Eqs. 1) and 16 are applied to Eq. 26, 


and the indicated integration is carried out, the 
error function becomes 


e(t) = 4M_,G, + (4M_,G,+M,G_)t + 


(27) 
+2 
+ (AM_jG,+AM,G,+0M,Gq) gp + ---- 
But the Maclaurin series for e(t) is 
+2 
AAR ites Neier eae BAe (28) 


r 
where E. = d_e(t) 


at” : ofoCo) 


t=0 
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If the coefficients of like powers of t are 
equated in the series of Eqs. 27 and 28, the co- 
efficients of Am(t) are given by 


E 
0 
Ae ke 
= CG, 
E. - AM .G 
1 = 
0 
‘ G 
Ey [am .o, + amo, | 


and, in general 


tae Boy” | OM 1841 ttMoGt-—t8M,_ 2G tem _Gy J 


r Go 


for all r21 3 where G) £50 


When Go = O, Eqs. 29 are indeterminate. 
Whether Go is zero or not is determined by the 
asymptotic order of G(s), where G(s) is the La- 
place transform of g(t). If 


G(s) 5 >» as s—>0o 


then, from the Initial Value Theorem, | Go #0. In 
the general case, where 


G(s) += > as S—™0O 


s 


then 


40 


= @n- = G 


= 05 q-2 


=O, but Gacy 


and, in fact, 


G. #0, for allr2q-1 . 


Based upon these results, it is clear that the 
first p coefficients of g(t) will be zero where 
p = q-2, and q is the asymptotic order of G(s). 


If the first p coefficients of g(t) are zero, 
the values of the coefficients of Am(t) may be 
obtained from a generalization of Eqs. 29. In 
this case, the coefficients are given by 


(30) 


E> [Am 3G, 548M C41 | 


SM, = G 
Pp 


al 


and, in general, 


SM= a 
P 


for all r21l , where G., #0 


The programming of the computer to solve the ap- 
propriate set of Eqs. 30, and the generation of 

the required Am(t) from the solutions of Eqs. 30 
are straightforward matters. 


3.4 Computer Program for Solution 
And Excitation Problems 


In the illustrative examples of Section 3.5, 
the series for co(t), g(t) and e(t) are each ter- 
minated after three terms, so that 


2 
t 
Co(t) = Coo + Cot + Coo ay (32) 
2 
g(t) = Gy + Gt + G, x (32) 
2 
t 
e(t) = E, + E,t + EB, or (33) 


Three terms are sufficient in each of these series 
because the value of T was selected (rather arbi- 
trarily here) to be short compared to the signifi- 
cant system time constants. The basis for selec- 
tion of the value of T is discussed in detail in 
Section 3.1. The number of terms necessary for 
good approximations of the functions co(t), g(t) 
and e(t) is determined by the value of T which is 
selected. 


The number of terms in the series for Am(t) 
is chosen in the examples to be the same as the 
number of terms in g(t). The correction is com- 
posed of an impulse, a step, and a ramp function, 
so that 


Amt) = AM_jBo(t) + OM, + dM,t , for +20 (3h) 


In any application of the ideas developed in this 
chapter, the number of terms used in Am(t) is de- 


termined by the number of terms chosen for g(t), 
by the control action required, and by the econom- 


Boer +1 bees +OM Ger’ Snare oon. ye Hae J 
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ics of the situation at hand. 


It is assumed in the illustrative examples 
that the system impulse response has a first order 
zero at s = 0, so that p = O in Eqs. 30. Since 
p = 0, Eqs. 29 may be used directly for computation 


of the coefficients of Am(t). Coefficients Go, Gy, 
and Go may be computed from the appropriate set o 


Eqs. 21. 


Calculations of Go, Gy, Go, AM_y, SMo, and 
SM are performed by the computer every T secoms, 
In any interval, nT <t<(n+l)T, in which e(t) = 0 
(i.e., Eg = E, = Eo = O) there will be no correc- 
tion. If, however, any one of the coefficients Eo, 
Ej, or Eo is different from zero, then a correction 
is needed. In order to compute the required values 
of AM_j, SMo, and AM, from Eqs. 29, the values of 
Go, Gy, and Gp must be known, If these are avail- 


able, then Am(t) is computed without difficulty. 
Whenever the coefficients of g(t) are not known, 
Am(t) cannot be determined. Measurement of the 
coefficients of g(t) requires that the system be 
in a dynamic condition. In order to enable the 
computation of Go, Gj, and Go when they are re- 
quired, but the system is not in a dynamic condi- 
tion, AM_j is made some appropriate value to get 
the system into a dynamic condition. The values 
of Go,G,, and Gy obtained in this measurement are 
then available for the computation of the values 
of SM_j, SMo and AM, which are required during the 
following control interval. This occasional re- 
quirement for a perturbation to be introduced is 
analogous to the occasional requirement for a per- 
turbation of an automobile by its human operator 
when he receives an insufficient amount of control 
information, as described in Section l. 


The sequence of calculations carried out by 
the computer at the instant t = nT is 


Le and E 


ag 2 
Tf Eo = E) = E, = 0, the sys tem be- 


havior is satisfactory, and no correction 
is necessary. 


loys 


Compute Eo» E from Eqs. 22 and 
28. 


a. 


If any one of the coefficients, Eo,E}, 
Eo is different from zero, a correction 
necessary. 


Ze 


a. and Go, Gj, and Go are known from an 
earlier measurement, then AM, AMo, ard 
ASM, are computed from Eqs. 30; and Am(t) 
is generated and added to m,(t). 

b. and Go, Gy, and Gp are unknown, then 
AM 4» and AM» and AM, cannot be computed. 


If a correction is necessary 


3. If Go, G1, and “» are unknown and are 
needed, as in 2b above 


a. they are, easily computed from Eqs. 21 
if the controller has applied a correction, 
dm(t), at t = nT. 


b. if there has been no correction applied 
at t = nT, then the controller applies an 
impulse at t = nT, of appropriate amplitude, 


|M_j|, as a test signal; where [M_,| is 
chosen sufficiently small so that there will 
be only an acceptably small disturbance of 
the system. A disturbance which is "accept- 
ably small" is a disturbance whose amplitude 
is negligibly small from the viewpoint of 
desirable system performance. The polarity 
of this test signal is chosen, each time it 
required, to cause the system error to 
reduced; that is, if e(t)>0, M.>0, and 
e(t)<0O, then M_,<0. ou 


- &ither the test impulse, or the correc- 
tion, Am(t), applied in step 3 above, per- 
mits the calculation of Go, Gj, and Gp from 
Eqs. 21. These values of the coefficients 
are then available for use in determining. 
the required values of AM_j, 4M, and SM), 
to be applied to the system during the next 
control interval, beginning at t = (n+1)T. 


The sequence of operations, l-l; above, is repeated 
at the start of each control interval. 


It should be noted that the values of Go, Gy 
and Go, to be used at the start of any interval 
for the determination of Am(t), are computed in 
the immediately preceding interval, so that the 
data being used are T seconds old. This makes 
evident the importance of choosing T small com- 
pared to parameter drift times. 


3.5 Illustrative Examples 
The procedure described in Sections 3.2 and 


3.3 was applied to a system with a stable impulse 
response, 


s+ 0.5 


(s+1)(s*e) 


and to a system with an unstable impulse response, 


G(s) = 


s + 0,5 
a) “Tori (sead 

In each case, the behavior of the system was inves- 
tigated by means of a digital computer for the 

case where c4(t) was a unit step function. The 
systems were initially inert. The value of T in 
both cases was chosen to be 100 milliseconds. 

This selection was rather arbitrarily made here 

so that only three terms would be needed in the 
series for g(t) and Am(t). In a practical appli- 
cation of the techniques presented in this chap- 
ter, the value of T must be chosen more carefully, 
to satisfy the conflicting criteria described in 
Section 3.1. 


The amplitude of the test signal, where it 
was needed, was chosen to be 


M_, = +0.01 


since this amplitude causes output variations 
which are negligible compared to cg(t). The (+) 
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sign was chosen when e(t)>0, and the (-) sign was 
chosen when e(t)<0, in order to tend to reduce 
the error rather than increase it. 


The error signal, e(t), and the forcing func- 
tion, m(t), are shown for 0<t<20T = 2 seconds; 
for the stable system in Figs. 2 and 3, respective- 
ly; and for the unstable system in Figs. ); and 5, 
respectively. It is seen in Fig. 2 that, with the 
stable system, the error reduces to a value below 
1% of cq(t) at the end of 0.1 seconds (one period 
of the computer), and then remains below this val- 
ue; and, in fact, the maximum error in each cycle 
is less than that in the previous cycle, after the 
fourth cycle. The system forcing function, m(t), 
is seen in Fig. 3 to approach, asymptotically, the 
value m = ); which is the steady state value of 
m(t) necessary to cause the steady state output to 
be c = 1, as desired. It is seen in Fig. , that 
in the unstable case, the error reduces to a value 
below 1.2% of cq(t) at the end of 0.1 seconds (one 
period of the computer), and then remains below 
this value; and, in fact, the maximum error in 
each cycle is less than that in the previous cycle, 
after the fourth cycle, just as in the case of the 
stable system. The system forcing function is sea™m 
in Fig. 5 to approach, asymptotically, the value, 
m = -23; which is the steady state value of m(t) 
necessary to cause the steady state output to be 
c = 1, as desired. 


5. 


A measurement technique has been presented as 

a particular solution to the design of adaptive 
control systems. The two illustrative examples 
presented, indicate that good control action is 
achieved. There are, however, a number of problems 
of considerable importance in adaptive control sys- 
tems, which have not, to the author's knowledge 
been dealt with in the literature in this field. 
Some of these problems are: 


1. What are the effects of computation time 
and computer errors on system performance? 


2. Under what conditions of operation, if 
any, may the system become unstable? 


3. How may the characteristics of the system 
response (e.g., overshoot, rise time, gain magni- 
tude, phase shift, etc.) to special classes of in- 
put functions, such as step inputs or sinusoidal 
inputs, be rapidly evaluated? 


Conclusions 


All of the foregoing questions must be answer- 
ed before the design of adaptive control systems 
will be established upon as firm a foundation as 
the design of more conventional linear feedback 
sys tems. 


(Ops 
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FIG.2 ERROR FUNCTION FOR STABLE SYSTEM 
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EXTENSION OF PHASE PLANE ANALYSIS 
TO QUANTIZED SYSTEMS 
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Great Neck, L.i., New York 


Summary 


The increasing applications of numeri- 
cal control of processes have created a need 
for new methods of synthesis of control 
equipment. The method presented is appli- 
cable to systems commanded by discretely 
valued inputs, and processes whose outputs 
may be similarly quantized. Periodic sam- 
pling is not required. The most suitable 
sampling is by transmission of only signif- 
icant data, as the new value obtained when 
the data are changed by a given increment. 
In certain cases, transmission of data by 
this means can be used to increase channel 
capacity. When the data are so quantized, 
the error signal is constrained to a finite 
numbers Of) diserete values, each: of -which 
‘may be associated with an area in the phase 
plane. Within each such area, the trajec- 
tories of any process subject to phase plane 
representation are a family of parallel 
curves. Thus, analytic synthesis may be 
simplified in thecase of certain nonlinear 
processes. Graphical design is facilitated 
without requiring deduction of a mathemati- 
cal representation of the process. 


The method is illustrated by synthesis 
of several systems involving a simple linear 
process. 


INTRODUCTION 


The increasing applications of numeri- 
eal control of processes have created a need 
for new methods of synthesis of control 
equipment. To cite a practical example, a 
tool may be positioned in accordance with 
data recorded digitally on a paper tape. 


In a quantized data channel the exact 
values of the data are approximated by se- 
lecting the nearest of a set of fixed val- 
ues,./as. in “rounding. off". a. number.. In 
transmitting data through sucha channel it 
is not necessary to sample periodically, 
but only when quantized data change from 
one possible valueto the next. If the sig- 
nal isnot continuously changing, the chan- 
nel might be made available intermittently 
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for other data without increasing its band- 
width. The particular transmission method 
assumed in this paper transmits new values 
of data instantaneously when the least sig- 
nificant digit of the rounded-off data 
changes. A means of storing the last value 
transmitted is also provided. 


A system using quantized data trans- 
mission is illustrated with the aid of Fig. 1, 
in which G is the process whose control is 
Gkesalieeiel hale) “Gals ates eCoimrelliicwes G6 sis; SuGia 
that m depends on quantized values of r and 
Cj €.2. © maybe transmitted from a numeri-— 
cal file such as punched paper tape and —c 
may be transmitted by a numerically indica- 
ting measuring device, though functionally 
SOlGlal Cjleioigaltaeheskoias ewer aharelhbeleyel “ain (G5 © 
operates upon the quantized r and ec in cuch 
away that m is similarly quantized, and 
any smoothing operations are contained with- 
ie (C5 leisy im acy —@Ceiaisimceaineel wer 2, See oie 
discrete values. G can be represented in 
the phase planeif it is such that for each 
value of m, c depends upon no higher than 
the second derivative of itself with respect 
to time. If in addition G is an integrating 
process such that when m is constant, c 16 
independent of c, the phase plane consists 
of a number of regions corresponding to 
values of m in which the trajectories are 
parallel. 


This application of phase plane analy- 
Sis is illustrated inthe following sections 
by first demonstrating its use with an on- 
off control loop, and then by improving the 
loop's performance by manipulations using 
the phase plane. Examples of compensator 
design by both analytical and graphical 
methods are included. The only generaliza- 
tion involves the applicability of the graph- 
ical method. The use of a linear process 
in these illustrations is for convenience 
in the introduction and to aid im the tran- 
sition from analytical to graphical methods. 


In all of the illustrations, the sys= 
tem is intended to respond to a step with 
a final error magnitude less than one-half 
the incremental unitof quantization, and 
shall have=no oscillation in” the steady 
state. Driving functions other than this 
step are not considered. The effect after 
quantizationof any other time-varying sig- 
nals is a successionof superimposed steps. 
Although these can be handled in the phase 
plane, itis doubtful that the mathematical 
labor is justifiable. . Therefore, such func- 
ti Ons Wallis novpabe= considered. 


THE UNCOMPENSATED SYSTEM 


A system in the form of Fig. 1, con- 
sisting of a continuous linear process and 
a controller that quantizes its output and 


compares it with a quantized input, gener- 
acing Jem OUuLpUG Una tout | aC, sor =i de= 
pending onwhether r - c (after quantizing) 
is positive, zero, or negative, respectively, 
can be represented by the block diagram of 
Ri gn ee. witclwi sescon avon ber almo roar ry son 
OPES VSueM) Wath san decad  ZOne =aliuslsnyOr Oe 
noted that the definition of the controller 
equates the unit of cy, the quanvizing in- 
crement, with the width of the dead zone, 
assuming one-to-one quantizing, which is 
adjusted in the assignment of a numerical 


iE 
. T K (uaa) 
=K Un Pe 
e e 10 
GO wWiMee 
eee oe Olnrrae 


Similarly, “in times T-atter applicataon oF 


Velo mnOmec eT Uc whee SemnumMerT cal ly sequal 
to the maximum value of ¢. 


Case idi j a PACTOC ie SUCTION 
§Sponse - The systemof Fig. 2 is absolutely 
stable. This will become apparent in the 


subsequent development. Whena step is ap- 
DIAEG, C WHI Be@elcicesSy eildleaat” wlale: SinSie 
is suLcucrenuly lance, CC wall’ “approach Kk, 
being practically equal to K when e enters 
the dead zone. If K and 7 are appropriate 
¢ will be reduced to zero with e = 0. The 
condition for this response may be derived 
Peon ue me OUAL LON Om. mMOLTOM ine icae dead 
zone, which is 


(eis the base of natural logarithms through- 
out this paper whenever it appears with an 
Srponeniwen. lie “chance in ic during this 
deceleration must be half the dead zone: 


L 
= 
at = 


© 1 
fipake ry 


1 
K SS pes 
eee) 


is a sufficient condition for the desired 
response. 


Mine, (GE: GeeeCe el “seOse ~ iwlalaeS) aLfoleie\Lalyaicte 
OPeravioOn We Intinite, since 


t 
Fe 


is nonzero forall finite t. For comparison 
of methods of reducing the response time, 
Bnei demerence tothe practical fact: that 
Luewidl bes prought co rest» by friction, the 
epoch of final’ value will be “arbitrarily 
defined as the instant when the velocity ¢é 
is reduced to 10 per cent of the maximum 
value, K. In this case deceleration time 
is defined: 
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lal) Siweio. 


t 
T -- ae 
ee A Kid = 60 bot. = KT ana 1 eer 


if al S\S7, 1¢ = KCT.-=.7). and. the «timer ere 
quired Tor “Ac nm ICE >a ain hes. 


By means of an approximation similar to 
Equation 1 it can be shown that this value 
of T is within 5 percent of -1/K. for a step 
On Seore more. hiss cle seamen recited mon: 


aesvep len.) 2 Sue 
legl-> leo b $5 
(So St crow St ae (2) e5| 4 2.337 
K K 


Phase Plane 


The phase portrait is the differential 
equation in c formed by eliminating t from 
the equations! expressing "c™ and -"c) in time 
functions. This is convenient for a linear 
process and is more generally applicable 
than more sophisticated methods. In partic- 
ular, the method of Kalman using singular 
POLNTS sas Noh applic ahem VOM blds sis Gen 
which has no singular points in the finite 
plane. 


Assuming initially ¢= 
t 
T 


Oo zhaiel tiie abe 


=Kii-e 


: eh 
ket -(l-e | 
T 


) 


oO 
| 


AG 


BRliminatine t, . , 
Ac =~Kr Jin(t- £)-<£ 
° [an e)- 2] 
In accordance with the assumption of an in- 
detinmicely. Larre sep. ¢ = K when ers ida 
minished to 1/2 and when m becomes zero: 
tthis is true in any region of the plane 
corresponding to zero loop gain, which is 
the distinguishing characteristic of on- 
off systems. In this case two of the sin- 
gular sponte! sre at -tntintty ana’ the 
third” is* the position axis (6e"=0,* eine 
determinate). 


Again eliminating t, 


Ac = 7(K - @) 


Although derived from particular initial 
conditions, it can be readily shown that 
these trajectories are completely general 
with an arbitrary constant of integration. 
Substituting -e for Ac and noting that the 
trajectories for +m and -m are negative 
functions, the general forms are 


ent Kr[1nd+ 7) - a 


oS (m = +1) 
(2) 
e=e,- Krlinti- 2+ § (m = -1) 
e— f= Te (m = 0) (3) 
where €, and e, are constants which locate 


the trajectories along the e axis. Equa- 
tions 2 and 3 represent families of paral- 
Tel curves. 


Fig. 3 is the phase portrait of the 
Case I system withe, = 4, drawn from the 
above equations. It is to be noted that 
the time required for this operation cannot 
be calculated from 


£5 & 


but that the approximation of Equation 1 
can be readily applied. This and subsequent 
portraits do not show the terminal condi- 
tions that arrest the systeminfinite time. 


Modified Phase Plane 


The response to successive small steps 
is sketched in Fig. 4, in which c is the 
abcissa. This shows that -the undershoot 
error depends on the size of the step, and 
that for successive equal steps the under- 
shoot diminishes to a limit. 


CaseII Zero-error Response with One Over- 
shoot - It is immediately suggested by Fig. 3 
that if K ean be increased by a factor 
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greater than 2 without changing 7, a zero-— 
error response may be obtained by permitting 
OnewOvershool ands tie oiIme requa reds noid 
large step Can be Reduced by a factor ap— 
proaching the change in K. More generally, 
DE Will be seen thay the product Kewas ain- 
ereased, implying no requirement for inde- 
pendenceofK and 7. Fig. 5 is a sketch of 
thes phase pomtrart. 


Kr may be found by simultaneous solu- 
tions of the trajectories for their inter- 
sections. — Assuming, as) tory Case). achat 
the step is sufficiently large that é ap- 
proaches -K at point 1, Equation 3 can be 
written: 


1 : 
SED =e = ke = Wee 
Pa 


ING jodi 28 


Aiea osil 3 
roar Kr = 7e9 
1 - Kr ee 
hy) = 
Ie, joonmgue, 3he3 
&7-4 =~ -eé 
Ese 
PLR (5) 


Since ey = e3) Equation 2 canbe expressed: 


a Cape etree q 1 

= = ee eee 
1n(1 Set ge ABD) Sees 

Race rae eRe Git TE 
Kr ier ee Or 
r- 1 
ee " Kr 
Kr = 1.63 


The time requiredfora large step may 
be obtained by summing the components To L1 
through T3 1 From Case I, 


Lo find Ti25 the-definite integral-of € may 
be set east to Ae: 
t 
wie eee 
Jy Sey eth an 
Ty-9 =7in 1 = 0.95 7 
Houdind. Tos: 
19-3 aa 
Dee arent a 67)= So) dy = 0 


0 


COMI De IESOLVCd., § DUG? this would = require 
solution of a transcendental equation. It 
is simpler to solve the &(t) equation: 


_ 3233 
(Rea Sen Les 6 ii y tiep = ez 
es 
Ue Cie g in C2 ot 
Equation 5: 
é = 25 
3 Bai 
Equation }+: 
ee ee 
CO = 
=7 in2= 0.697 


fo find T3-) Equation 1 is used except 
that in this case 6 is initially €2. 
Equation 3: 134 


T 


Be 
10 


e = 


ez 4 


134 = 7(in 5 - 1n Kr) = 1.12 +. 
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iMaks) ineheeil als 


ih 
ae 


K 


leg| + 6.13 |eg| + 6.13 


T 


+ 3.76 7 = 


K 1.63 


An attempt to extend this case to an 
overshoot and an undershoot yielded trans- 
cendental equations whose solutions did not 
fall out readily as did Equation 6.) Kr can 
be estimated by successive approximations 
using the graphical method illustrated later. 


Comparison -of Case= land Caseulh — sin 
most practicaivcases, Kvand ey Varenorscen— 


tirely independent. In the case of a me- 
chanical systemitis expected that the ma- 
chine is of an economical size and is ef- 
ficiently utilized, so that available torque 
is limited.+*Then?-the’ factor#Kk, canyberad— 
justed only by changing the amplification 
between the machine and the load. If the 
load is pure inertia, the time constant of 
the process depends on the amplification 


factor: 
K 2 JL 
7 ae dee Ba) ie! 
Ko Jy 
where To = 7 when K = Ko 
Kak : Ben 3 
Ko? change in amplification factor 
J; = load inertia 
Jy = motor inertia 


The dependence of 7 on K can be calculated 
Iva Speci Ce Casges where rd L/IM is constant, 
and where gear inertiais Pither negligible 
or may be adequately accounted for by in- 
cluding the input pinion in Jy or conceiv- 
ably where gear inertia is a known function 
of K. From this dependence it can be de- 
termined whether the product K7 can be made 
equal to that required for either. systen, 
and then whether the time required for a 
desired €9 canbeless than the time speci- 
fied for thessysrem. Thitss cal.culation jean 
be facilitated by estimating “K siliehnily 
greater than e)/T, then calculating 7 from 
the above equation, and proceeding with suc- 
cessive approximations if a solution exists. 


The only case that can be generalized 
gta ne Tor comparison is that in which 
Jj, = 0. This case occurs in practice in in- 
strument servos in which (K/Koj)* Jz,< < Jy. 
Assume that 7=1. For Case I: 


T= 2| eq | = eat SC 
gual stone (CRISE. IMLS 


le, |+ 6.1 
T = O 3 = leg | 


SSS 3.76 
mS 


The systems 
Rigye6\ 


are compared graphically in 


The small step response is not as or- 
derly as for Case I, as may be seen in the 
more completes phase portrait of Fig. “7. 
The unit step response may be particularly 
troublesome in a real system having fric- 
tion. The modified phase portrait of suc- 
cessive whit steps is shown in’ Fig. 8, a 
graphical construction in which the steps 
are numbered chronologically. These re- 
sponses appear to be nearly haphazard. It 
would be good practice to provide a mini- 
mum step input of three. 


DECELERATION BY REVERS AL 


Case III - The system is compensated by 
a nonlinear delay network incorporating de- 
lay D such that when the error enters the 
dead zone, the process is reversed for a 
fixed time and then shut down. D is such 
that the shut-down occurs at e = 0, €=0 
at |é| = K at the instant the error enters 
the dead zone. For steps not large enough 
for the error rate to approach maximum, the 
DEOCeSoewmiErle reverse.) Laer coast tO aresu. 
Input m, and output m5 of the network are 
related on the same time scale in Fig. 9. 


If |é| K at the instant when m, be- 
comes zero and m5 reverses its sense, 


le] =(2e7- 1K 


Dis defined: 


2% 
2-Eat = T= 0 
D = 71n 2 = 0.697 


= in e in time 


LO SLO Deraun. © O the change 
D must equal 1/2: 


t 


al 
fe ) dt =— 
fe al t 5 


on 


Kr = 1.63 
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The large-step response time is: 
1 il 
Jeol => (aie 
aaa ane cas D = = +. 15697 
leg| - 2.26 
k 
; leg| - 2.26 
: Tee te: 


ines phase portralb 2s Showin fae. Oe 


In this system the process does not 
eome tO rest atier a unit) step, but oseil— 
lates about. je|= 1/2. The limit cycle is 
not shown on the phase portrait because it 
depends on a more complete description of 
D. In this case the process is reversed 
and Sicoasts back ta |e|<>.172,>0utuorgthe 
dead-zone, and drives: back ~ain again. Ihe 
second excursion of e inand out of the dead 
zone is completed before the lapse of de- 
day D.» If the delayed. pulse overrides=sm), 
an oscillation tracing alternately large 
and small loops in the phase plane results 
with an amplitude which does not diminish 
to zero. If the delayed pulse adds to m, 
an oscillation of a series of similar loops 
results. Ifm, overrides the delayed pulse, 
a diminishing oscillation results with the 
final position at e -~1/2 and the oscilla- 
tion frequency ~®, 


Incidental nonlinearities, such as 
friction, might be employed to halt the 
process before it re-enters the e >1/2 
zone. Accounting for nonlinearities in the 
design of this and the previous systems 
involved merely the use of the appropriate 
nonlinear differential equation. Similarly, 
it wa. brake could be actuated pm uheame— 
quired time, this design could be reduced 
to a. nonitinesar=Caseo-Lior Case: Lis system. 
If itisfeasible to measure €, the process 
might be shut down when 6 is nearly zero. 
It,is, of? cotrse, possible to; stabilize 
this system by constraining inputs to Ar 2 2. 
This could be done quite easily by quantiz- 
ing r ain twice as many increments.as are 
required for resolution and using only even 
numbers, which requires only that the least 
significant bit«be ~weroyifor <8 coded in 
binomial binary or any other weighted code. 


Case IV - Co ter Compensate i 

System - Optimum response of the system will 
be obtained if the process is reversed at 
the proper instant to reduce error and ve- 
locity to zero simultaneously. The large 
step response of the Case III system is 
nearly optimum with a simple "computer." 


In this case the reversal time will be com- 
puted so that the process will coast to rest 
in the dead zone. A generalized configura- 
(ealeyal als} Slelonimauesine Iaber, Wl 


The ideal system computer would cal- 
culate from the initial error ep the Time 
function:2 

+(8(0) aero by act, S(t) | 


where t; andtoaredefined by the equations 


for é¢ = 0, |Ae| = |le,|: 
ty eee 
ii =e. ase] ce = i= @ 
SS ee am eo 
- (1-e ate J, [l1-e ae a0) ss - Jat - e 


The practical difficulty of causing the pro- 
cess tohave zero error and zero rate simul- 
taneously, andof shutting down the process 
When thiseas “So, 1S) partially alleviated 
by bringing the process into the dead zone 
at a value of é€ sufficiently small that it 
WilieCcOads bs vO! reste within tbhesdead zone. 
The problem is illustrated graphically in 
Fig. 2. The intersection of the trajec- 
tories at ej is found by solving Equation 2: 


aay eel 


é é 
€5 + Kr {1n (1 ee al as ae Kr (in (1 - K 


-NVNi-e 


The error 
versed is: 


Swau when the process isi re= 


emeeeri=ekr tint 1+ Nine 


(7) 


A second condition that must be satisfied 
Mim Oraet TOM Deine we DpMe: SySvem Gorrestess 
illustrated in Fig. 13. In the equation 


“suggested by "Posicast" system of Smith 


3This requirement is less stringent than 
to bring “to rest with e O. The con- 
venience of this freedom will be apparent 
subsequently. 
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of the reversal trajectory, eg is the mini- 
mum er 


ep er erode (8) 
for which the system will come to rest. 
Since the equation of the terminal trajec- 
tory is Equation 3: 


1 ‘ 
e — — 
9 Te 


the point 


is the intersection, and (Equation 8): 


1 
== + 


e 
7 


1 
(2 + —) cae 
Kr tin ee =} 


(9) 

The computer in the block diagram of 
Fig. 11 calculates e, according to Equa- 
tion 7, compares e with e,, and inverts e 
when e = e,. Thus operated upon, e is m,. 
it “would not sbe Sieasi ples com colveriquaq 
tion 6 “on line" by analog methods, but 
discrete, precalculated values of e; can 
be: selecteds by quantizing+e,-. +The resoius 
tion required in quantizing is determined 
by eg- That is, the precalculated e, must 
be such that 


€o < ef Ane: 


in Equation 7, evaluated from exact values 
of eo. 


Inthe other systems, it is of no con- 
sequence if the comparator inputs are quan- 
ULZed. In this case, however, the error 
at reversal ,is critical. Fig. 14 “4lius- 
trates the effect of the unit of quantiza- 
tion being equal to thewidth of the dead 
zone. A further effect not shown is due 
to €o having a range of values + 1/2 about 
an integer. Excluding this, it is seen 
that reversing the error at any instant 
when c changes from one quantized value to 
the next cannot produce a near optimum 
response. 


4Tf r and ec are constrained to integers, 
the nonlinearity introduced -in Fig. 1.is 
intrinsic in the comparator. 


If the system could be designed to 
have ec <0, the desired response could 
always be obtained for |e,|-” provided 
that c were quantized inincrements of 1/2. 
This may be visualized graphically by noting 
that a given change ine, produces a smaller 
change iner forall |e,|<. For decreas- 
ing |eo| the restraint one, is more severe, 
or conversely, fora given eg smaller quan- 
tizing increments permit smaller |e, |. How- 
ever, if Kr —1, the system reduces to Casé 
I, and the minimum |e,| from Equation 9 is 


1 
leolmin = in 2 peewee: 125 


DESIGN IN THE PHASE PLANE 


The examples illustrated previously 
have demonstrated the utility of the phase 
plane wasman. aids to trvaisualuization ~andyiits 
use in facilitating an analytical design 
in certain cases where other methods are 
unwieldy or inapplicable. However, two dis- 
advantages became apparent inthe course of 
developing those examples. In an attempt 
to generalize Case II transcendental equa- 
tions were encountered. Also, little light 
has been shed on manipulation of nonlinear 
processes. Both difficulties may be re- 
moved satisfactorily by effecting design 
by graphical construction in the phase plane. 
It is necessary only that G be constrained 
and the regions be defined as stated ear- 
ior swhich- sy tousayrthapwan each rercion 
the dynamic behavior of G is independent 
of initial conditions. Additional remarks 
concerning the characteristics of G are 
given later. An illustration of the graph- 
ical method will be given now using the 
linear process treated in the previous cases. 


Equations 2 and 3 may be written as 
functions of the same variable, é/K. 


Equation 2: 


fa cS é 
perce, We gi Gy OR Ws Siraed Bee 
"7 T[in (1 "7 " 


mo 
els 


&g é é 
Fel 1 -—) +— 
= 7{in (1 " a 


| 


Equation 3: 


Since eg and ey are arbitrary, the implicit 
equations 
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Equation 2: 
See eet tale) (10) 


and Equation 3: 


ee (11) 
" re 11 

describe the dynamics in the phase plane. 
Since the phase plane trajectories, HEqua- 
tion 2, are imaged in the point e =éa, 
é<= 0, itis possible to construct a single 
pair of curves defining the system dynamics, 
Equations 10 and11l, where 7 and Kare scale 
factors applied tothe plane. These curves 
Can pes cus anea plasvac vemplavcestomaneap— 
propriate scale and design effected by trial 
layout in the phase plane. Many of the 
figures in this paper were so drawn. 


Let it be assumed that the process is 
such that no adjustment of K yields the 
product 7K smal enough for Cases Tyyls or 
Pil eand= ches maximum IS veDe asec pe Camenedr 
To) estamatre™ wheter a ‘case IVdesien eas 
possible, adaptation of the equations used 
to obtain the response time for Case II is 
made, giving as an approximation to response 
times 


leg) <> 
soar ee ss 
K 


where Tis maximum time of response to max- 
imum step e, and K and 7 are compatible 
parameters of the process. If a K and + 
thatmsabisty tneldmequalavy exist thes de 
Signis possible. Thisws not an expression 
for optimizing the “system for this step, 
since it assumes that the maximum é€ is ob- 
tained, and does not preclude improvement 
byvincreasing’ K “ain! all@-cases.= Dteis -an 
approximation because the termin includes 
deceleration by reversal from maximum é@ to 
rest, and also because the coefficient of 
rt is rounded to a whole number. However, 
an initial approximation to the maximum K 
(and 7) that can be used, as well as the 
minimum K, can be made. 


An attempt will now be made to design 
a systemfor which the approximation 7K = 6 
is adequate andrealizable. Fig. 15 illus- 
trates the procedure used. In this modi- 
fied phase plane, the initial value of c 
can have any value in the 0 range. If the 
final value of c im’tesponse 16 ai step of 
Pi is tobe constant in the 2l*range, the 
deceleration must intersect the transition 
between 20 and 2lwithé between O and 1/T. 


Lieo  "ASe quantized sin unit 

Switching fromthe accelerating 
decelerating mode must occur 
bounded by the two accelerating 
can be seen ior steps or 2 or greater, 
itvis necessary to calculate e7; "and measure 
e to a greater accuracy than unit quanti- 
wevgakorml, lint {sal sy (opbkewahoslvqctol\~ atic, aulbysiin, JoXe’ ale) 
units of 1/4, assuming binary quantization. 


increments, 
mode to the 
in the area 
curves. As 


Working to successively smaller steps, 
iis mseen) thatiroriw en 1=) 6, “e “must: be 
quantizedin smaller increments; in this 
case, 1/16..-Asie, is reduced, at is'ap- 
parent that the increments must be still 
smaller because the range of e in whitch 
switching must occur becomes smaller until 
atereoe 6 jontbe vanishes. hist difficulty 
may be relieved by quantizing e, in smaller 
increments. Since it has been determined 
that e must be quantized in increments of 
1/16, eg may be also. The smallest switch- 
ing rangefora step of 2 (from the O range 
LG@ethe. 2 range) is for ‘a-step fromthe 
highest (leftmost) increment in the O range. 
This switching range is greater than 1/16, 
so that any step of 2 or greater may be 


made. However, all steps of 1 cannot be 
made without still smaller quantizing in- 
crements. 


Aside from these mathematical diffi- 
culties, other highly probable effects serve 
to render this system impractical. It is 
acuGeny  SeusitivesoO “changes, in 7 and K, 
and practical components are not as well 
behaved as the idealized curves due to bear- 
ing irregularities, slot effect, commuta- 
tion, eccentricities, imperfect gearing and 
temperature, to name only those pertinent 
to electric motors. It may be postulated, 
however, that small transportation lags, if 
predictable, due to data transmission, com- 
parison, computation, etc., may be compen- 
sated in the computation. 


APPLICABILITY OF THE METHOD 


This extension of phase plane analysis 
requires that the process operate in defined 
regions wherein the phase plane loci are 
parallel, whichimplies that within a region 
there is no feedback around the process. 
It is seen in the examples given that, due 
to the nature of the nonlinearity, no ex- 
pression that is valid within a region can 
be written for the transmission from e to 
Ce There must be effectively a nonlinear- 
ity providing a finite number of constant 
inputs to the process. 


Oh describing function for the nonlinearity 
cannot be written without a signal of suf- 
ficient amplitude to cause a switching ac- 
tion, which accomplishes a transfer to an- 
other region. 
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The process itself must be such that 
for each input, its behavior is described 
independent of previous history - reiterat- 
ing, c depends uponno higher than the sec- 
ond derivative of itself. Or, stated di- 
rectly and mechanistically, acceleration may 
be any single-valued function of velocity. 


These conditions permit analysis with- 
out recourse to approximations such as the 
straight-line representation of smooth non- 
linearities commonly used to obtain describ- 
ing functions. The phase plane loci of. an 
efficient induction motor may be obtained, 
for instance, from speed-torque curves and 
the total inertia; and if additional non- 
Llinéarities suchas coulomb friction exisic, 
or if ) thessloadseiners ayes acelin te Onmots 
velocity (a centrifuge, for instance), the 
loci may be obtained directly from records 
of velocity versus time. The latter re- 
course may be used even in the case of ma- 
chines such as synchronous electric motors 
that hunt’. 


The student of nonlinear control sys- 
tems will recognize a similarity between 
this extension anda method of analysis for 
systems having backlash. The present exten- 
sion was suggested by that method, and the 
similarity may suggest other applications 
not foreseen by the author. 
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FIG. 11. GENERALIZED OPTIMUM SYSTEM 
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FIG.12. OPTIMUM SYSTEM 


FIG.13. DETERMINATION OF ec 
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FIG.14 QUANTIZED OPTIMUM SYSTEM 
EFFECT OF UNIFORM QUANTIZATION 
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SIMPLIFIED METHOD OF DETERMINING TRANSIENT RESPONSE 
FROM FREQUENCY RESPONSE OF LINEAR NETWORKS AND SYSTEMS 


Victor S. Levadi 
Antenna Laboratory 
Department of Electrical Engineering 
The Ohio State University 
Columbus 10, Ohio 


Summary 


Knowing the frequency response of a linear 
system, a method is presented for obtaining the 
time response of the system to an impulse, step, 
or ramp function input, without performing 
graphical integrations. 


The transient response is of the form 


f(t) = ia A;G(<;t) 


1 


where a different function G is used to deter- 
mine the response to each of the three types of 
input. 


Tables of the functions G(x) are provided. 


An example is given to illustrate the sim- 
plicity and accuracy of this method. The results 
are compared with the exact time response. 


Introduction 


The prediction of the transient performance 
of linear systems based on their steady state be- 
havior is a problem continually encountered in 
design and analysis of communication networks 
and control systems. The mathematical treat- 
ment of this problem is quite easily handled by 
means of Fourier or Laplace transform tech- 
niques. However, the transformation of these 
results from the analytical domain to the realm 
of numerical reality is often a tedious process at 
best. 


Both Guillemin! and Floyd’ have presented 
approximate methods of obtaining the impulse 
response of linear systems. In order to obtain 
the step or ramp response, these results must 
be integrated by a numerical or graphical tech- 
nique. 


Guillemin's method, for small values of 
time, requires taking the difference of large 
numbers which are nearly equal. This makes 
the numerical calculation an exacting task. 
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This discussion will present a method 
whereby the response of a linear system to an 
impulse, step or ramp input can be computed 
directly by a relatively simple means. The 
problem of computation for small values of 
time is greatly reduced, and, with the tables 
provided in the Appendix, the calculations are 
of a simpler form than for either of the pre- 
vious methods. 


The required information can be obtained 
experimentally since only a graphical repre- 
sentation, rather than an analytical expression, 
for the system frequency response is needed. 


Analytical Development 


Definition of Input Functions 


Throughout this discussion the impulse, 
step, and ramp functions will be defined as 
follows: 


Impulse function =lim g(t, 5) 


6+0 
where 
1/5, 0<t<65 
g(t, 5) = 
0, elsewhere 
By 10) 
Step function = 
0, t<0O 
tet. 
Ramp function = 
Gots 0 ne 


Preliminary Development 


Guillemin’? has shown that only the real, 
or imaginary, part of the frequency response 
of a network is sufficient to determine the 
transient response of that network. 


If f(t) and F(jw) are a Fourier trans- 
bo} ot o oy oF. is a Oe - 


f(t) = eal F(eion ds (1) 
2 ae 
and 
F(jw) = ir £(t)e It at, (2) 
where 


r((is)) =O) siobe is-<< 5 


then Guillemin shows that 


Hee Z { Ris \ conte. de: (3) 
0 
and 
i (t)== 2 I(w) sin tw dw. (4) 
0 


R(w) and I(w) are the real and imaginary 
parts of F(jw), respectively. 


F(jw) = R(w) + jI(w). (5) 


f(t) is the response of the system to an 
impulse function. 


Consider the problem at hand. Given 
the frequency response function, it is desired 
to determine the transient response of the net- 
work or system. 


Since either the real or imaginary part 
of the frequency response function is sufficient 
to determine the transient response, we choose 
to use only the real part, R(w). 


Physical limitations on the system re- 
quire that 


liny F( jw) = 0 5 (6) 
jw 

Hence, 
lim R(w) s.0 . (7) 


Woo 


If the system is stable 


lim jwF (jw) = lim f(t.) . (8) 
jw 0 ba co 


Since the right hand side of (8) is finite, 


lim R(w) = constant. (9) 
w>0 


With restrictions (7) and (9) on R(w), 
consider an arbitrary function R(w) such as that 
shown in Fig. la. 


Response to Impulse Input 


In order to perform the integration of (3) 
the curve R(w) is approximated by a series of 
N straight line segments as shown by dashed 
lines in Fig. la and again in Fig. 1b. For the 
illustration the approximate curve contains 5 
segments. N=5. The first segment begins at 
w = 0 and extends tow =a,. The coordinates of 
the end points of the first segment are (0, R,) 
and (w,, R,). The slope of this segment is R,. 


R, -R 
Ri ee ee (10) 
W] 


For the ie segment the beginning and end 
points are (wj-,, Ria ),(o;, Rj) . 


; R; = R; 
Ro pees (11) 
3 @; - Wi-1 
Also 
Ryn = 0, (12) 
and 
Ryn+ = OF (13) 


Integration of (3) by parts gives 


. G)=00 
£(t) = 2 [Rte sin tw 
ui t w=0 
” R'(w) sin tw at (14) 
ae a ical 


Conditions (7) and (9) require that the 
first term of the right hand side of (14) be zero. 


Substituting the straightline approxima- 
tion for R(w) into (14) and considering (13), 
yields 

f(t) =- 


dw, (15) 


2 fies Pate) sin tw 
0 t 


T 


where f,(t) is the impulse response of the sys- 
tem using the straight line approximation for 
R(w). 


Breaking the integral (15) into the sum 


of integrals along each line segment of the ap- 
proximate R(w), and noting that 


R'(w) = Rj for wi-) < wSw;, (16) 
there results 
N (ei Risin tu 
Sioa ge Se (17) 
Piciy cic 


Integrating and rearranging terms gives 


N 
es ! 1 2 COS w:t 
ih < : Eg Sp ee BEY 
a: (w;t)? 
i=0 1 
where, by definition 
Ro =0. (19) 
Recognizing that 
N , ‘ ‘ 
Sea =Ro-Rnn = 0, (20) 
i=0 
(18) can be rewritten as 
N 
Zz 1 1 2|cos w:t-1 
fo(th =) F(Ri-Rin )0j/——— | (21) 
(wt) 
i=l 
Making the following definitions; 
bj = (Rits - Rybo;, (22) 
2m lig=cos x 
G ee acer eg (23) 
o(%) TT x2 
(21) becomes 
N 
fot) = ) byws Golit) (24) 
ial 
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Response to Step Input 


The response of the system to a step func- 
tion is the time integral of the impulse response. 


t 


fy (t) = { fo(n) fe (25) 
0 


where f,(t) is the approximate system response 
to a step input. 


Defining 
G, (x) = Fagen du , (26) 
0 
(24), (25), and (26) give 
N 
fy (t) = > b,Gy (at). (27) 


i 


It can easily be verified from (23) and (26) 


[ 


that 


G, (x) = 2| sion - ee (28) 


where 


Stix )es i at 
0 u 


we 


(tit - 


(29) 


Response to Ramp Input 


In a similar manner, the ramp response of 
the system is the time integral of the step re- 
sponse. 


t 


£, (t) -( Alco hee (30) 
0 


where f,(t) is the approximate response toa 
ramp input. Defining 


G2 (x) = (Cam du, (31) 
0 
(27), (30) and (31) give 
> b 
i 
Glee a Gz (w;t), (32) 
ha 


where 


Gatxiee = [x Si(x)-(1-cosx)-Cinx], (33) 


and 


(34) 


The Functions G., G,, G2 
oe 

The functions G,, G,, and G, are shown 
ru A Pees AAS 


A brief table of these functions is pro- 
vided in the Appendix. iy 


The process of computing the time re- 
sponse of the network becomes a relatively 
simple matter. The constants b; need only be 
computed once for a given system. 


The only operations required in the com- 
putations are multiplication and addition. These 
calculations provide excellent results with slide 
rule accuracy. With a desk-type calculator the 
process of multiplication and summation can be 
combined in the single process of "accumulative 
multiplication, "' further simplifying the compu- 
tation. 


*Copies of a more extensive and detailed table 
of these functions will be available upon request 
from the Antenna Laboratory, Department of 
Electrical Engineering, The Ohio State Univer- 
sity, Columbus 10, Ohio. 
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Error 


The two sources of error in this technique 
are due to approximation of the frequency re- 
sponse curve by straight line segments, and 
also the error in computation. 


Approximation Error. The difference be- 
tween the true and approximate frequency re- 
sponse functions can be reduced by increasing 
N, the number of line segments in the approxi- 
mate function. As N gets very large the ap- 
proximation error becomes very small. 


The amount of computation is proportional 
to N. Therefore, the choice of the approximate 
R(w), and N is a compromise between accuracy 
and ease of computation. 


Another form of approximation error is ap- 
parent when considering the approximate impulse 
response, f,(t), for small t. 


From (23) it can be shown that 


0 


> as 


(35) 


sj 


Using (35) and the limit of (24) ast > 0 
gives N 


lim f,(t) = 1 y byw; . (36) 
t+0 "i=l 
(22) and (36) reduce to 
N 
lim f,(t) = ee (Ria -Rit )oj. (37) 
t-0 us i=l 


If the approximation to R(w) is not such that 
the right hand side of (37) is 0, then the approxi- 
mate impulse response, f,(t), will not begin at 
0. Rather, its initial value is that given by (37). 


Even if the approximate f,(t) does not begin 
at 0, the useful information derived from this 
curve will not be altered significantly. The in- 
formation generally desired from the impulse 
response is peak amplitude, frequency of oscil- 
lation, and settling time. It can be seen from 
the example given later that these quantities de- 
rived from the approximate response compare 
favorably with the true values, even though the 
approximate curve does not begin at 0. 


For the step and ramp response 


lim G; (x) = 0, 
x0 


(38) 


and 


lim G(x) = 
t-0 
Hence, it is obvious that both the computed step 
and ramp responses will always converge 
smoothly to Oast—> 0. 


(39) 


Computational Error. The functions G, (x) 
and G2(x) approach values of 1 and x - 2/n énx 
for large x. Hence, the numerical computation 
of (27) and (32) for large t involves taking the 
difference of nearly equal numbers. To reduce 
the effects of error in this process (27) and (32) 
can be written as 


_N N 
frat) a= ) bi +) bif Gi (ait)-2] (40) 
7 td 
abo: 
f2(t) ah t+ Si | Ge (uit) at. (41) 
at 1= 
Using (22), (40) and (41) reduce to 
_N 
| 
£25 
i 
-_ 


The first terms of (42) or (43) represent 
a quasi steady state or equilibrium value. This 
response has the same shape as the input func- 
tion. The summation terms of (42) and (43) 
represent the deviation of the response from the 
input wave form. 


For large time the deviation term of (42) 
approaches 0. 


If Ry = 0 the deviation term of (43) ap- 
proaches the value 


N 
te 
w 
i=] 


i 


cos wit 


a ln 


for large time. Since the deviation terms are, 
much smaller than the equilibrium terms, the 
calculation of (42) and (43) does not involve 
small differences of large numbers. 


yy 


Programming on Digital Computer 


Both of the previously mentioned errors can 
be reduced or eliminated by programming the prob=- 
lem on a digital computer. Obviously, this 
greatly reduces the computational error. 


Since the machine computation is relatively 
easy and fast, a large number of very short 
straight line segments can be used to approximate 
R(w). This reduces the approximation error. I 
In fact, as N gets very large, the results will 
approach the exact time response. 


The functions Gp, G, Go can be computed 
with relative ease by using Serracchioli! 
method for generating the Si and Cin functions. 


It should be noted that the computation of 
the step or ramp response using the G functions 
involves only one approximation, replacing R(w) 
by the straight line segments. However, if the 
step and ramp responses were computed by succes= 
sive numerical integration of the impulse 
response, the result would contain the cumulative 
error of each integration. 


Summary of Formulae 


To summarize the results so far: 


Small t Large t 
Impulse N 
Response ) Pinole) same 
fo(t) jh 
Step N N 
Response ) Pica (w;t) = b; ) mf (wt) - 
fy (t) i=l 
Ramp Mos 
Response ye G2 (w;t) Re tt) alee (w,;t) “os 
f ( t) i= | t=] 
where 


= (Rit - R,) @; . 


Numerical Example 


As an example, the approximate impulse 
and step response for a feedback system rep- 
resented by the block diagram of Fig. 3 will be 
computed. 


The open loop frequency response function 
is 


35),0 


Glia) 4-35 a ee 
jw(. 01 jot 1)(.02 jo +1) 


The closed loop frequency response func- 
tion becomes 


G( jw) 
1 + G( jw) 
bez 8 exaw 2 


F(jw) = 


(-150w? +1. 781 0°) +7( -w? +5000 w) 


R(w) and the straight line approximation are 
shown in Fig. 4. 


R(w) could also have been obtained di- 
rectly from G(jw) by use of Floyd's chart. * 


The following values are obtained from 
this figure: 


R,=1 IN 
Ry = w, = 23 
R, =-.65 +w2 = 41.5 
R3 = -.65 wr = 50 
R4 =n) W4 = 108 


The solution is now straightforward, as 
follows: 


Ry 


I 

iT] 
fo) 
i 

iT] 
is) 


ae 8 OS = 
R; = Soe =r0892; Ri.» .013 


b, =(-. 0892-0)(23)=-2.051 b,w, =-47.18 


b2= Bs (al b2w2=153.8 
b3 = . 560 b3 3 =28. 01 
bg= -1.210 b4w4=-135.5 


f(t) = -47.18 Go( 23t) +153.8G,(41. 5t) 
+28. 01 Go( 50t) -135.5G,(108t). 


f, (t) = =2.051 G, (23t) +3. 701 G, (41. 5t) 
+. 560 G, (50t) -1.210G, (108t). 


hor t= 0205 


£,(.05)=-47.18 Go(1. 15) +153. 8 G,( 2.075) 
+28. 01 G,(2.5)-135.5G,( 5.4) 
=-47.18(. 2847) +153. 8(.2193) 
+28. 01(. 1835) -135.5(. 0079) 
=24, 37. 


f, (.05)=-2. 051(. 3530) +3. 701(. 5879) 
+. 560(.6735)-1.210(..9006) 
=.739. 


The exact time response calculated by the 
Fourier transform method is 

fo (t) sub 4sieme co Castes as 
cos (35. 5t - 109°30'); 


= -14. 6t 
ee Ske a ee: 


cos(35.5t-40°51'). 


The approximate and exact time responses are 
compared in Figs. 5 and 6. 


Conclusion 


A method has been presented whereby the 
impulse, step, or ramp response of a linear 
system can be computed knowing the frequency 
response. Any one of the three time responses 
can be computed separately. No graphical in- 
tegrations are necessary. 


With the table of functions provided, the 
computation of the transient response is con- 
siderably simpler than for previously described 
methods. 
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Appendix 


The following brief table of functions is sufficient for most slide rule calculations. For greater 
accuracy and ease of computation, more extensive and detailed tables are available from the Antenna 
Laboratory, Department of Electrical Engineering, The Ohio State University. 


S% Go (x) x Go(x) 3 Go(x) x G,(x) G2(x) Se G, (x) G2 (x) 
0.0 -0.3183 10.0 0.01171 20.0 0.00094 0.15 0:0318 0..0031. ~670° 0.9028. 3.8629 
2 3172 2 1050 2 00Le2 2 0636 0073 2 9028 4.0435 
4 3141 4 0919 4 150 3 0953 0149 4 9028 2240 
6 3089 6 785 6 7a 4 1268 0257 6 9029 4046 
8 3021 8 652 8 202 5 1581 0398 8 9031 5851 
70m 0-2927.9 112000. 00524- 21.0: 0.00223 6 1891 0570 7.0 0.9036 4.7658 
2 2819 2 404 2 241 7 2198 0773 2 9044 9466 
4 2696 4 297 4 254 8 2472 0982 4 9056 5.1275 
6 2559 6 204 6 263 9 2801 1271 6 9071 3088 
8 2411 8 128 8 265 1,0 0.3096 0.1565 8 9089 4903 
250052254 12.0 °0::00069. 22.0 0.00263 1 3387 1888 .8.0 (0: 9810) 5.6723 
2 2089 2 28 2 256 2 3671 2240 Z 9134 8548 
4 1920 4 6 4 243 3 3950 2620 4 9161 6.0376 
6 1749 6 0 6 227 4 4223 3028 6 9189 2211 
8 1586 8 1l 8 207 5 4489 3463 8 9218 4051 
3.0 1408 13.0 0.00035 23.0 0.00184 6 4749 3925 9.0 0.9248 6.5898 
2 1242 2 7% 2 160 7 5001 4419 2 9278 7750 
4 1083 4 116 4 135 8 5246 4924 4 9307 9609 
6 0932 6 168 6 110 9 5483 5460 6 9336 7.1473 
8 0790 8 224 8 86 220° 0.5713° (076019 8 9362 3342 
4.0 0.06579 14.0 0.00280 24.0 0.00064 1 5934 66014/10:0. 10,9387) - «7.5214 
2 5378 2 336 2 44 2 6147 7205 Z 9409 7096 
4 4299 4 387 4 27 3 6352 7829 4 9428 8980 . 
6 3346 6 432 6 15 4 6548 8474 6 9446 8.0867 
8 2521 8 469 8 06 5 6736 9138 8 9460 2758 
5.0 0.01824 15.0 0.00498 25.0 0.00000 6 6915 9820 11.0 0.9472 8.4651 
2 1251 2 516 2 ) @ 7086 1.0520 2 9481 6546 
4 0797 4 524 4 4 8 7248 1236 4 9488 8442 
6 456 6 522 6 10 f°) 7401 1969 6 9493 9.0341 
8 217 8 509 8 20 3.0 50; 7546: :1 2716 8 9496 2239 
6.0 0.00070 16.0 0.00487 26.0 0.00033 1 7683 3477.12 9498 9.4319 
2 05 2 456 2 48 2 7811 4251 13 9500 10.364 
4 1l 4 419 4 64 3 7931 5038 14 9515 11.314 
6 73 6 376 6 81 4 8043 5837 15 9555 12.267 
8 180 8 329 8 97 5 8148 6646 16 9606 13.225 
7202 0,00320 917: 07-0, 00281 .*27.0°.0.00113 6 8245 7466 17 9646 14.188 
a 481 Ds 232 2 127 7 8343 8378 18 9662 15.154 
4 653 4 185 4 139 8 8417 9132 19 9664 16.120 
6 825 6 141 6 149 9 8492 9977 20 0.9668 17.086 
8 990 8 101 8 156 4.0 0.8561 2.0830 21 9684 18.054 
8.0 0.01139 18.0 0.00067 28.0 0.00159 2 8681 2553 22 9710 19.024 
2 1268 2 39 2 160 4 8777 4230 23 9733 19.996 
4 1371 4 19 4 157 6 8853 6062 24 9745 20.970 
6 1445 6 6 6 152 8 8912 7839 25 9747 21.944 
8 1489 8 0) 8 143 5.0 0.8955 2.9625 30 0.9795 26.827 
9.0 0.01502 19.0 0.00002 29.0 0.00132 2 8986 3.1419 35 9820 31.728 
2 1485 2 10 2 120 4 9006 3218 40 9838 36.643 
4 1441 4 25 4 105 6 9018 5020 50 9873 46.502 
6 1371 6 45 6 090 8 9025 6824 60 9894 56.385 
8 1280 8 68 8 75 
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Fig. 1b. Straight line approximation showing data necessary for calculations. 


Fig. 2. The functions Gg, Gj, and Go 


<(jw) =F (jw) 


Fig. 3. Block diagram of linear system with unity feed- 
back, 


0.8 
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Fig. 4. Real part of frequency response function and straight line approximation for the example. 
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Response — f)(t) 


Impulse 


Fig. 5. Comparison of the exact and approximate impulse response. 


f, (t) 


Exact 


Step Response 


-——--—-—-Approximate 


Time. t 


Fig. 6. Comparison of the exact and approximate step response. 


66 


A NEW METHOD OF ANALYSIS OF 
SAMPLED-DATA SYSTEMS 


A. Papoulis 
Polytechnic Institute of Brooklyn 
Brooklyn, New York 


and 


Burroughs Corporation 


Summary 


In many sampled-data systems the sampling 
interval T is ''small'' and the response rg(t) 
closely approximates the response r(t) of the 
continuous system; one is then interested in 
evaluating the difference rg(t) - r(t) for various 
values of T. In this paper this difference will 
be given as a power series in T whose coeffi- 
cients can easily be determined in terms of the 
continuous response; if one wants to estimate 
the size of T for rg(t) to equal r(t) within a spe- 
cified error, the first term of this expansion 
will give an adequate measure of the error and 
hence of the maximum permissible T. Further- 
more, since the resulting series converges 
rapidly, the expansion provides a simple methad 
of evaluating rg(t) for a given T. 


The method is applied to a feedback system 
with a sampler; the singularities of the p-ration- 
al system function that gives the actual response 
at the sampling points, are obtained by a dis- 
placement of the singularities of the continuous 
system function. 


I. The Euler Summation Formula 
Applied to Sampled- Data 


We define the output of a sampler (Fig. 1) 


by oS 


f(t)= T > £(nT) 6 (t - nT) (1) 
n=0 

The output of a system to f(t) and f we denote 
by r(t) and r,(t) respectively; we did not use 
f(t) for the output since r,g(t) and r(t) are not 
of course related by an in similar to (1). 
The above definition of f(t) differs from the 
usual by the factor T; this factor was intro- 
duced so that 


pee Bh = r(t) (2) 


The output of our system to the given input f(t) 
is a function of the sampling interval T; it can 
therefore be written as a series 


x(t) = ro(t) + r, (t) T + r5(t) rT Foe a. (3) 


Clearly 
ro (t) =ar(t) (4) 


and our problem is to determine the remaining 
coefficients in (3). 
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With H(p) the system function and 
-1 
n(t)= L-! [Hp] (5) 
its impulse response, we have for a given 
t= ni (6) 


t i 
a(S Hi f(t) h (t - tT) dtT= J 4m dt (7) 


where 
(tT) = f(t) h (t - 7) (8) 
and 


T f£(kT) h (t - kT) 


v(t) 


(9) 
T (kT) 


Thus r(t) is the area under $(tT) and rg(t) is the 
area of the inscribed staircase (shaded in Fig. 2). 
The problem of relating these two areas is very 
common in numerical quadratures and there are 
solutions of various forms; a quadrature formu- 
la that would lead to a simple determination of 
rg Should contain no interior points but only 

the values of ¢ and its derivatives at t= 0 and 
t=nT. The following satisfies these require- 
ments. 


Euler Summation Formula 


It can be shown (see Appendix) that if F(x) 
is analytic then 


b n- 1 
Sf Fey ax= > TF Kr) 
a k=] 
(10) 


(ee) 
a 3S ate By [#9 e-2% May 


where (b-a)/n = T and the B.'s are the tabulated 
Bernoulli numbers: ; 


Zee _ - 
N= Bites ROR oe watt Bont) =10 
1 spniat Lee] ns hla 
BP Ab ae 1p 0 bs ke ee 
Ee: 691 7 
Ne TIN Cee ES ek 


This formula is used to evaluate an integral in 
terms of the values of F(x) at x = kT, and the 

values of its derivatives at the end-points; we 

shall use it in reverse: From (10) we have 


n=l t 
SS EA ieee 
k=0 (@) 


(11) 
B, [ oMeary-g™ M0) | 


foe) 
k=1 a 
and with $(T) as in (8) 


rg (t)= x(t) -  [£(tyn(0)-£(0)n(t) | + (12) 


If T is smaller than the smallest time constant 
in the response, then (12) converges rapidly; 
it gives a method of evaluating r,(t). For 
"small" T 


r(t)= x(t) - F [«¢eyn(0)- £0 y(t) 


We thus obtain a simple estimate of T for r g(t) 
to equal r(t) within a given error. 


Equation (12) could have been obtained from 
the formula for r_(t) derived with the usual 
methods if all terms were expanded into series 


in T and collected; however the resulting expres- 


sions are indeed complicated and it is not so 
easy to recognize them in the simple form (12). 


Example 

A 

f(t) = u(t) H(p) = Tey Ba 
(p+1) +4 

We chose a simple example to facilitate the ex- 

act determination of r(t); the series in (12) can 

be as simply evaluated for any H(p). The rate 

of convergence is the same for any system 

whose time constant are of the same order of 

magnitude. From (12) we have for f(t)= u(t) 


= [nit n(o)| +2 fees, re [a- n'(0)| 


4 
+a oman + 


ro(t)=r(t)+ = 


For our example 


r(tjzl-e ° 
-t 
ve e 


h(t)= a sin 4t, cos 4t 


sin 4t 
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The exact response at the sampling points, eval- 
uated with the usual methods, is given by 


r.(t) = A (1-e' cos 4t) + Be" sin 4t 
where 
=D" a 
Le e sin 4T 
ASSIA eco = Tae = ee a 
l-2e cos 4T +e 
Wy Bats - BF ees 4T 
eee —T 27 
l-2e “cos 4T +e 


In Figures 3,.4 and 5 we have plotted the exact 
value of ri (t) and the functions 


s(t) = r(t) +> [ nie) - h(0) 


Z 
a(t) = 5,(t) +2 [n(ty - n1(0)] 


ior, T= 205;432Nand 5: 


Even for T =.5 whichis larger than 1/8 = By, 
s,(t) gives a satisfactory estimate of r,(t) re 
an error less than 3%, for T = .05 the tennis 

s, (t) suffices; the error is less than 1%. s,(t) 
agrees with r.(t) up to the 5th significant figure. 


Steady State 


The steady state r,(t) can be readily evalu- 
ated from (12); the terms containing h(t) and all 
its derivatives tend to zero for large t, hence 
with r(t) the steady state of the continuous 
system we have 


F(t) = F(t) - 5 £(tyh (0) 
2 (13) 
aS fe (t)h(0)-£(t)h. (0) | + re 
Special cases 
(a) f(t) = 


F (t)=F(t)-  h(0)- 


u(t) 


ie 
Al : 3 
zh (0)- a5 ah! ot. 


(b) £(t) = sin wt 
cos wt 


with v(t) = A, sin wt + B, 


r(t)= A sin wt +B cos wt 


we have from (13) 


Ae ae BO) e 


: Ue 


2 


Te 


B 
s 


Hold Circuit 


The hold circuit can be considered as part 
of the system; the combined system function is 
given by 


eats 
H,(p) = —T H(p) 


and its impulse response by 


BS re [ a(t) ¥ a(t-T)| (14) 


where a(t) is the step response of the original 
system function; therefore (see (12) ). 


r s(t) aE (c) 
1 (15) 
-5 [£(e0(0)-£(0)a(t)-£(0)a(t-T) yes 
since a(t) = 0 for t<0. The steady state is 
given by 
E(t) = E(t) - = £(t) a(0) 
(16) 


1 ! 
2 £ (t)a(0)-£(t)a (0) 25 
as we can readily see from (13) and (14). 


Il. Transforms of Sampled-Data 


The Euler formula,can be used to determine 
the transform F(p) of Ft) as-a series in T. With 


CO [e@) 


F(p) = / eP* g(t)dt = _/ a(t)at (17) 
0 6 
where 
q(t) = e P* £(t) (18) 


and F(t) as in (1), we have 


[0 @) 
Sees ePityat = >| Tq(nT) (19) 
0 n=0 


therefore (see (10) ) 


F(p) 


(ee) 
B 
Fig) Da iT? air (o) 
n=1 : 


(20) 


2 1 
F(p) +5 £(0) -- E (0)-p#(0)] Pat: 


since q’ (co) = 0 for every n. 


Response 


With R(p) = H(p) F(p), 


the transform R.(p) of F S(t) is given by 


R.(p) = H(p) Flp) (21) 


* 
as one can readily see from the definition. R{p) 
can be written in the form 


Rip) = [Ry(p) +R, (e) T+... | (22) 


where Ro(p) = R(p) is the transform of the con- 
tinuous response, and 


RP fy(d| k= 1, 2, 


are functions to be determined. From (20), 
(21) and (22) we obtain 


[R+R, T + 2 a= [ =(oy+T x, (0)+. - | MA 


-[H+Sn(oy+...] [r+ 3x0) +...] (23) 


Equating equal powers of T we obtain R,, R,, 
.; the result agrees with (12) but the details 
are omitted. 


Example 
ie 
f(t) = ult), -H(p) = ——;—— 
(ptl)° +4 
r(t) = isettos aes > 5 SE 


R,(p)= > r(0) + 5 h(0) F(p) + 5 £(0) H(p) 


H(p) 


NIE Ne 


hence 
i 
ry (t) = 5 h(t) 


R,(p) = py [ PH) - 17 Fe) | 


oy [» w - (0) 


r(t) 


The results agree with the previous develop- 
ment of the same example. 


III. Feedback 


Consider the system of Fig. 6; its system 
function is given by 


a 
* 
I Seale tise 


For a system without the sampler 


where H(p) ae (25) 


The poles of Hy WercenoOtesDiVepas -1se > 
1 
thus 


ri H 
HES ISAK 


Pe aicastss Posted 
Dip_,) + KN(p_,)=0 m=l,..., 7 (26) 


The poles pe of Fy depend on the sampling inter- 
val T; for small T they can be obtained from ae 
by a linear displacement 


To determine Apm we expand H as in (20) and 
insert into (24) 


2 
H(p) +—-h(0) - 4y-[h"(0) - ph(o)]+... 


* 
He 
f£ 
1+ k H(p) +SEn(0) - -[h8(0)-pn(o)] +... 
(27) 
Pe is a root of 
D+xn+ [4 n(o)-... ] D=0 (28) 


We shall retain only first order effects. 


P,, Simple: if h(0) # 0 then we can readily ob- 
tain from (28) the following expression for Ap,- 


easier 
AP eo (0) A (29) 
where 
D(p) (p-p,,) 
oe ¥ D+kKN (30) 
pepe 


is the residue of 1/(1+ kH) atp=p_j;i.e., the 
displacement is proportional to T. vale h(0) = 0 
we consider the next term in (28); we then obtain 


2 i 
Noman Ata 5(0) (31) 


where A_ as in (30). 
m 


Pm multiple: if the multiplicity of pm is r 
then (28) gives the following results. For h(0)#0 


kT 
AP», =| - So ee) (32) 
where “ 
Ee te D(p) (p-p_,) OR 
aa D+kN a 
P=P,. 


Thus from each pole of of multiplicity r 
there result r poles for on the vertices of 


a regular polygon with Pm 28 centers) 5 hor 
h(0) = 0 


2 
af kT 
APE a \ pe OE (34) 
where B __ as in (33). 
m 
Examples 
! 
ee py h(0)=0, h (0)=1 
pitadp dap 
Pi 
DikN=p-tap+btk, = -at jp 
P2 
For B # 0 
pe apis “ a 
i, eo Pi) ~ “Zap 3 
For B = 
ape 
£ oe ol er 
pee Pq tet peg 
3 
(see Fig. 7a) 
Disc 
2. H(p)=—s————_ (0) = 1 
peo Opie) 
P} 
DikNep fuptotkietc) = - at jp 
P2 
For 6B #0 2 
-k(p) +c) LTH pjte 
Ate = = : 
Lrtteajiee, AP Sap ty 
For B = 0 
«°T 
B, = - k (c-a) AP, =* SS (c-a) 


(see Fig. 7b) 


Appendix 


To prove (10) it suffices to take n = 1 since, 
if the formula is established for each i rval 
and the results are added, the terms ing Joc) 
evaluated in the interior points cancel. eee 
ing F(x), F (x), ... into a power series and in- 
tegrating from 0 to T we obtain 


T 
ile 
J Pecjax-F(oyr+ 2 0)T* , F (oT? 1 
0 
ab ‘mi 72 
JF (@)axeF (0)T +2 OF + Si 
0 
¥ k+1) " 
/ Do ieleeepe LTO) Tg ptt, Ge 
6 


We next multiply the k+1 equation by C,. k=1, 
Zee anduaddsathe eat C, are ee chosen 
that the coefficients of F' ON: Tesi, AR esis alta 
the r.h. side of the resulting equation are all 
equal zero. For this to be true the C;'s must 
satisfy the following equations. 


vy C, Tae 0 hence Ci== 5 
Bi - cP 46,1 = 0 hence ogee 
Lea ¢, I feta C,T=0 hence C,=0 
as eee DR Sa 4 CeT 00 


From the above equation (10) readily follows and 
the Bernoulli numbers are obtained through a 
recursion formula. 


Tf(nT)8(t- 


nt) 


Big.1; 
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STATISTICAL FILTER THEORY FOR TIME-VARYING SYSTEMS 


Elwood C. Stewart and Gerald L. Smith 


National Aeronautics and Space Administration 
Ames Research Center 
Moffett Field, Calif. 


Summary 


The guidance and control accuracy of most 
aerodynamic and space vehicles is limited prima- 
rily by the noise disturbances which enter the 
guidance system. Present theory for the minimiza- 
tion of these noise effects does not take into 
account the forced kinematic time variations, such 
as is due to time-varying range, which occur in 
most guidance problems. Such time variations 
occur in interplanetary flight, satellite rendez- 
vous, interception of missiles or bombers, and so 
forth. In this paper an analytical approach is 
presented for the optimization of systems which 
are forced both to be time varying and to operate 
with inputs contaminated with noise. 


Two objectives are the establishment of the 
theoretical optimum performance and a method of 
synthesizing the optimum control system. Effects 
of restrictions on the capability of the output 
element in addition to the noise and the forced 
time variation are considered. Although an exact 
analytical solution of the problem does not appear 
feasible, it is shown how approximate solutions 
utilizing time-varying control systems can be 
found. The method is illustrated by a hypotheti- 
cal example of a homing missile attacking a 
bomber. 


Introduction 


The use of statistical filter theory in the 
design of systems is now well established. It has 
found application in commimication systems, auto- 
matic control systems, and weapons systems. The 
reason for the usefulness of the statistical 
approach is not hard to see. In the first place 
the inputs to systems often can be represented 
only in statistical terms, as, for example, the 
signal input in a communication system, the 
motions of targets, etc. Secondly, there are 
invariably introduced into the system some con- 
taminating signals called noise which are also 
best handled statistically. Consequently, statis- 
tical theory and its application to system design 
has grown in importance. 


There are a great many possible statistical 
approaches to take. Foremost of these is the 
well-known Wiener filter theory. Many later 
works have dealt with a number of modifications to 
this original work. There are several assumptions 
which are generally common to many of these 
theories. One of the principal assumptions is 
that the systems to which the theory is to be 
applied are time invariant or at least are not 
forced to be time varying. Although many problems 
fall in this category, there is a large class of 
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very important control system problems which are 
inherently time varying so that present theory is 
not applicable. Consequently, the purpose of this 
paper will be to show how statistical theory can 
be extended to these time-varying problems. In 
particular, we will be concerned with the synthe- 
sis of optimum time-varying systems. More detail 
than can be given in this paper will be found in 
reference 2. 


Problem Description 


In the optimization of time-varying systems 
it is important to distinguish between two time- 
varying aspects. The over-all system may be time 
varying because (1) certain forced time variations 
appear in the system as a result of its mode of 
operation, or (2) a time-varying control system is 
employed purposely because of advantages to be 
gained by so doing. Both kinds of time variation 
may occur of course in the same problem. 


One of the most important types of forced 
time variations, and the one with which we will be 
concemed here, is illustrated in Pigs. )On the 
left is a space vehicle in the mid-course guidance 
of an interplanetary flight, and on the right is a 
homing missile intercepting an enemy bomber. The 
guidance of such vehicles is accomplished by 
employing line of sight information which there- 
fore involves range. Since this range varies con- 
tinuously during a flight, these problems are 
necessarily time varying. The time-varying situa- 
tions illustrated here may be recognized as 
belonging to a large and important class. Similar 
situations arise for instance in studies of fire- 
control systems, aircraft landing systems, and so 
forth. 


The class of time-varying problems illus- 
trated in Fig. 1 can generally be described in 
terms of linear time-varying differential equa- 
tions, or, as is completely equivalent, in terms 
of a block diagram such as shown in Fig. 2. Here 
we see that the error signal is modified by a 
time-varying element before it is available for 
use by the controller. It is this element which 
establishes the essential time-varying nature of 
the problem. For the type of problem which was 
illustrated in Fig. 1 this variation is a kine- 
matic relationship of the form 1/R(t), where R 
is the range between vehicle and destination. 
There are other time-varying problems in which the 
forced time variation may occur in some other 
location in the block diagram or in which more 
than one time-varying element may occur. However, 
all such problems may be treated in a similar 
manner. We will confine our study specifically to 
the time-varying problem illustrated in Fig. 2. 


The two inputs to the system in Fig. 2 are 
the true signal information and a contaminating 
noise signal which enters with the desired infor- 
mation. The noise signal is due to the uncer- 
tainty in measurement of the signal; it might 
arise from errors in star tracking, errors in 
radio communication, or from errors in a radar or 
an infra-red detection system. These two inputs 
are modified by the time-varying element. The 
remaining portion of the block diagram is the con- 
trol system which closes the kinematic loop. 

Since the control system is invariably limited in 
its capabilities, it is generally necessary to 
impose a constraint on the most critical quantity 
within the system. Thus, it is desirable that the 
control system be split up into a controller and 
output element as shown so that the quantity to be 
constrained, r, appears explicitly. This quantity 
might represent a linear or angular acceleration, 
the control motion of a missile, or the thrust 
from reaction controls, for example. The output 
element is the fixed element which might represent 
the dynamics of the space vehicle, missile, or 
whatever, depending on the application. Merely 
for simplicity here, this element is taken to be 
of a typical form k/s?. The other element of the 
control system is the controller which the 
designer is presumably free to choose. 


The optimization problem we wish to solve can 
now be expressed as follows: If (in Fig. 2) we 
are given the forced time-varying element, the 
statistical properties of the signal and the noise, 
we would like to find the controller which will 
minimize the error e¢ and yet not require of the 
constrained quantity r more than the system 
capabilities. The problem is similar in concept 
but basically more complicated than the time 
invariant case which was treated in reference 3. 
The general class of problem we are concerned with 
is characterized by the fact that the error need 
be minimized only at a particular time T (the 
time of arrival at the destination, target, etc.) 
but the system capabilities should not be exceeded 
at any time ts previous to T. Ensemble 
averages are particularly meaningful in this type 
problem. Mathematically such problems are treated 
by minimizing the quantity 


(1) 


where the quantity p is a Lagrangian multiplier. 
From physical reasoning, the restriction on the 
quantity r should be constant at the maximum 
permissible value throughout the entire flight. 


€2(T) + pr2(to) 


Solution 


There are several steps involved in the solu- 
tion of the problem as stated and they will be 
enumerated in the following discussion. 


Adjoint Theory 


The first step is to convert the differential 
equations in the real-time domain to a new kind of 
time called adjoint time. The way in which such a 
concept comes about is as follows. It is known 
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that when a time-varying system is activated at 
time zero and thereafter subjected to a stationary 
random process with a constant spectral density of 
unit magnitude, the mean-square ensemble average 
of the error is given by 


to 
i h?(t2,t1)dty 
° 


where h is the error response at time tps due 
to an impulse introduced at time +t ,. For example, 
in Fig. 3, if an impulse is introduced into the 
system at time t ,', the error response as shown 
might be obtained. The value of h at the 
desired time ts is indicated. If the impulse 
were introduced at another time +," as shown a 
different response would be obtained and so forth. 
Note that these responses are plotted as a func- 
tion of time t for a fixed time +1. However, 
in equation (2) it is necessary to have h asa 
function of +t, fora fixed t since the integra- 
tion is with respect to t ,. Such a response 
could be obtained by cross-plotting the curves 
given, and the result might appear as given at the 
bottom of Fig. 3. However, this procedure is com- 
pletely unsuited to the synthesis problem we have 
here .< 


€2(to) c= XT 


(2) 


A better procedure is based on a transforma- 
tion of the real-time differential equations to 
the corresponding adjoint differential equations. 
It can be shown that the solution of these equa- 
tions gives the desired response h(to,t1) as a 
function of +, as required in equation (2). In 
other words the solution of the adjoint equation 
is the response shown at the bottom of Fig. 3. 
The transformation involved here is related to the 
reciprocity principle which is common in many 
fields. Two familiar examples are the well-known 
reciprocity theorem in circuit analysis, and the 
Rayleigh-Carson antenna law. Here reciprocity 
manifests itself by an interchange of the input 
and output positionwise and also timewise, the 
latter being achieved by running time backwards. 
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Derivation of Equations 


The second step in the solution is to derive 
the necessary equations, and to examine possible 
methods of solving these equations. Expressions 
for the two quantities of interest, the error and 
restricted quantity should be written in terms of 
the adjoints of the unknown controller which we 
wish to determine. This is done by transforming 
to the adjoint equations or corresponding adjoint 
block diagram, from which the error and restricted 
quantity can be written:* 


Error: 


noise component signal component 


ee 


(FE A na 
Soe LL next + {trots =) -n(r=x)Ing(edax} an (3) 
n(r) = 5 [fecer ee [er ffec evar ar at (4) 


Restricted quantity 


noise compoment Signal component 


a eee 
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e(rsta) k @ 
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As can be seen, to relate the error to the con- restrictions. It does suggest, however, that even 
troller impulse response e(T,€) requires two with a restriction included, the optimum perform- 
equations, The first relates the error to the ances of the time-variant and time-invariant 
intermediate but unknown impulse response h(T); systems ought to be the same. The optimum perform- 
the remaining factors in this equation are known mance of time-invariant systems can be determined 
when the inputs are specified. The second is an by well-known optimization methods and, by the 
integral equation in which this same response h above argument, this result should also be the 

is related to the controller response e(7,€). optimum performance of the time-varying system. 
Together these two equations relate the error to This is illustrated in Fig. 4 by the two curves 
the controller. A similar situation exists for with restrictions; the upper solid curve repre- 
the two equations for the restricted quantity. sents the exact solution according to constant- 
Consequently, the quantity to be minimized, coefficient theory. 


€2(1T) + pr2(to), is expressed in terms of the 
unknown controller by means of these four equa- 
tions. It is these equations then together with 
equation (1) which comprise the exact formulation 
of the optimization problem. 


There are many compelling reasons to support 
the above argument. Merely from physical consid- 
erations we would expect that as long as the output 
element and the restriction on the input to this 
element is the same for both systems, there would 
be no inherent reason why this output element 
could not be controlled as well for both systems. 
There are many other reasons too lengthy for dis- 
cussion here. Nevertheless we can say that as a 
good approximation the optimum error performances, 
with restrictions, of both the time-varying and 
non-time-varying systems are identical. 


The problem now is one of solving these equa- 
tions for the optimum controller eats). Unftor= 
tunately these equations are so formidable that 
exact minimization does not appear feasible. Con- 
sequently an approximate solution has been sought. 


A clue to such a solution can be found when 
the restriction is eliminated, that is, the system 
is assumed to be linear regardless of the magni- 
tude of signals within the system. For this case 
p = O and the equations can be readily solved. In 
order to illustrate the solution, a typical 
example situation for a homing missile attacking 
an enemy bomber has been taken. For this situa- 
tion the minimum obtainable error at the intercep- 
tion time, that is, the miss distance, has been 
determined and is given by the lower dashed curve 
in Fig. 4 as a function of one of the most impor- 
tant parameters, the noise magnitude. As indi- 
cated, this result is valid for all time-varying 
systems. The important clue is that this curve is 
identical with that which is obtained for a com- 
pletely constant-coefficient system as is indi- 
cated by the lower solid curve. This result is 
valid of course only for the case of no 


Synthesis for Optimum Error Performance 


The third step in the solution is to synthe- 
size the controller so that the optimum error 
performance will be achieved, while the restric- 
tion requirement is temporarily ignored. It can 
be seen from the first error equation, (3), that 
to have the same error performance as the constant- 
coefficient system it is only necessary that the 
response h be the same. This h is obtained 
along with the optimum error performance from the 
time-invariant optimization theory. Having h, 
the second error equation, (4), can then, in 
principle at least, be solved for the desired con- 
troller c(t,&). However, solutions of this inte- 
gral equation are not easy to obtain. The 
difficulty appears to be in the manner of repre- 
senting the control system by a single impulse 


76 


response. Since the impulse response of even a 
physically very simple time-varying system may be 
completely unwieldy, we would expect the impulse 
response for the optimum controller to be even 
more unmanageable. Consequently, it has been 
necessary to find another representation. 


A more suitable representation which has been 
found is based on splitting up the controller into 
several parts, each with its own impulse response. 
Such a form is illustrated in Fig. 5 where the 
controller has been broken up into three parts: a 
time-varying multiplying part and two non-time- 
varying parts. This form is quite general and yet 
a practical one easy to construct. Moreover, it 
is this formulation which is needed to enable the 
optimum control system to be synthesized. An 
equation which replaces equation (4) can now be 
derived - one that relates the response h not to 
ce as in equation (4), but rather to the control 
system components as it has been broken up in 
Fig. 5. It can be shown® that this equation is 


instructive to illustrate the results for only two 
of these controllers. For the first, let us take 
the simplest form of control, a constant- 
coefficient controller, for which f(t) in Fig. 5 
is a constant. For the second, we will take a 
Simple time-varying controller in which f(t) is 
range, that is,a range multiplication controller. 
When the necessary equations are solved, it is 
found that the first system turns out to be what 
is known as proportional navigation. Furthermore 
it is interesting to note that for both systems 
the form of the required radar tracking system 
Yo(s) in Fig. 5 is such as to call for differenti- 
ation (as well as filtering) of the line of sight. 
This result is gratifying because it is exactly 
what one expects on the basis of heuristic 
reasoning. 


Now let us examine the performance of these 
two systems. The miss distance (or error) per- 
formance of both systems is the same and is given 
by the upper dotted curve in Fig. }. However, the 


n(n) = $8 ya(0)e) e(rye (SS) |b ot fvacedel (0) [n(r-m) [Pf wvaGedax ax ax] (1 


Now for certain time-varying functions f(T) this 
equation can be solved for the remainder of the 
controller Y,(s) and Ys(s). Thus the desired 
impulse response h and therefore the desired 
error performance can be achieved. Actually it is 
found that there are many solutions of equation (7) 
so that a whole class of time-varying controllers 
can be generated all of which have the desired 
error performance. 


Satisfying Restriction Requirement 


The fourth and last step is to satisfy the 
desired restriction requirement which has been 
temporarily ignored. This can be done as follows. 
Each of the systems which satisfy the desired 
error performance will have different restriction 
requirements throughout the interval of interest 
O to T. Thus from this whole class of systems 
satisfying the error performance, the one or more 
having the desired restriction characteristics can 
be chosen. We would expect that if a system with 
uniform restriction characteristic were chosen, 
this level would be identical to that imposed in 
the time-invariant optimization. 


Example 


To illustrate this method of solution let us 
consider in more detail the example case of a hom- 
ing missile attacking an enemy bomber, as was 
illustrated in Fig. 1. This problem can of course 
be cast in the block diagram form shown in Fig. 5. 
The signal would represent the true target posi- 
tion, and the noise would represent the error in 
the measurement of this target position by the 
radar; the block Yo(s) would represent a radar 
tracking system and filtering and Y(s) the auto- 
pilot. As has been indicated, there are many 
controllers which can be synthesized to satisfy 
the desired error criterion. It will be most 


demands on acceleration are vastly different as is 
illustrated in Fig. 6. Also shown in this figure 
is the design value which represents the desired 
restriction level on the amount of acceleration. 
The choice between the two systems is clear. The 
first, proportional navigation, calls for too 
little acceleration early in the flight and as a 
consequence attempts to make up for this deficiency 
by calling for more than its capabilities later in 
the flight. Consequently, limiting would occur 
and the miss distance would be greater than that 
shown in Fig. 4. The second system, the range 
multiplication controller, is much better in this 
regard because the desired restriction level is 
approximated very closely throughout the entire 
flight. Thus this system achieves the optimum 
error performance and satisfies the desired 
restriction on acceleration very closely. 
therefore an approximate solution to the 
optimization problem. 


It is 


Concluding Remarks 


It is desirable to point out that although 
the example presented here was a specific homing 
missile problem many problems can be cast in a 
similar form. The reason is that both noise 
effects and the time-varying range which exists 
between vehicle and destination are common 
ingredients in the automatic control and guidance 
of many vehicles. There are applications, however, 
which may differ principally in the location at 
which the noise is introduced. Such changes are 


. not fundamental and similar methods may be used. 


It is also important to emphasize that 
optimization theory does not eliminate all prob- 
lems in the design of automatic control systems. 
There are many factors which might influence the 
specific design of a system as for example, the 
necessity of using certain fixed and unalterable 


elements in the system or the introduction of 
artificial damping to the vehicle. Fortunately 
the optimization theory presented herein does not 
prescribe one unique system; in other words, there 
are many ways in which the optimum performance can 
be achieved. For this reason it is usually 
possible to include other requirements in the 


design without sacrificing the optimum performance. 
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ON THE PHASE PLANE ANALYSIS 
OF NON-LINEAR TIME-VARYING SYSTEMS 


Richard F. Whitbeck 
Systems Requirements Department 
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Buffalo 21, New York 


Summary 


A phase plane technique, which takes advan- 
tage of convenient relationships in other planes 
(for example, displacement versus time) to effect 
graphical solutions for a non-linear time varying 
second order differential equation, is developed. 
Several special cases of this general second 
order equation are considered. The special 
case of mostpractical importance occurs when the 
differential equationis permitted to become piece- 
wise linear. To demonstrate the simplicity of the 
technique, for the piecewise linear case, anexam- 
ple involving saturation in an inertially damped 
position servomechanism is given. 


Introduction 


In this paper, the phrase ''phase plane techni- 
que'' is interpreted to mean any approximate 
graphical solution method that interprets a first 
order derivative as a slope in its appropriate 
plane (for example, du / dx defines the slope of a 
solution curve inthev,x plane, while dz/dt de- 
hinesmthemeslope Ota. solution curve in the 7 ,; 
é plane).* Admitting the above as a reasonable 
definition of a phase plane technique leads rather 
naturally to the idea of using more thanone plane 
simultaneously to effect approximate solutions to 
problems described by non-linear time varying 
differential equations. 


" 


The paper deals specifically with a second 
order equation, although the technique describedis 
general enough to be applied to higher order sys- 
tems (this is demonstrated in an appendix fora 
third order non-linear time-varying differential 
equation). 


The accuracy of the technique can be greatly 
enhanced by carrying along a solution curve ina 
seemingly ''redundant"’ plane. For example, if 
solution curves are being constructed simul- 
taneously in the v,x and v,@ planes, a construc- 
tion in the x,@ plane should yield the same value 
of 2% as was obtained in the v,x plane, and the 
same value of t as was obtained in the v,t plane. 
The tangential segments which approximate the 
solution curves must be decreased if the values in 
the ~tplane do not check, within some acceptable 
degree of accuracy, with those obtained in the other 
two planes. 


* An explicit definition of the term "phase plane" 
does not seem to exist in the literature.Apparent- 
y, a "phase plane" has some dependent variable as 
the absicca, with the derivative of the dependent 
variable as the ordinate. Hence, velocity, dis- 
placement and acceleration, velocity planes would 
be phase planes, while displacement,time or accel- 
eration, displacement planes would not be. 
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Several special cases of the general second 
order differential equationare consideredin order 
that the reader may clearly comprehend the widely 
varying amounts of work required in effecting a 
solution as the equation is permitted to take on 
more restricted meanings. 


An important practical objective of the paper 
will be to introduce the reader toa more general- 
ized Lienard's construction, since it handles the 
majority of non-linear problems encountered in 
everyday engineering in a more efficient manner 
than the majority of other contemporary techni- 
ques. An example involving saturation in an 
inertially damped position servomechanism is 
given to demonstrate the simplicity of the techni- 
que when applied to piecewise linear problems. 


The various cases will be considered in the 
sections to follow, beginning in Section 1 with the 
general second order differential equation. 


Section 1 


A General Second Order Equation 


This paper will be concerned with the phase 
plane solution for the second order differential 
equation 


AlX,V,t) 2X4 b(L,V,t) £+C(H,U,t) x = F(t). (1-1) 


In’ Equation (l=) ago. 21. ta) oN Cee) 
and c(x,wu,¢ ) are coefficients dependent on 
the signal, its derivative and time. #(¢t ) rep- 
resents the forcing function which, in general, is 
time dependent. 


Letting =v, noting that L= = dh OS and 


dividing through by the coefficient of X gives Equa- 
tLOng l= 2))e 


dy _b(x,v,t) CCL, Vt) pee FE) 1-2) 
SCL (0G, Usb) 2(%,%,t) A(X,v,t) (1- 
or 
_ $4,u,t) .._ C(%,u,t) CEA 
CP EES, 2(%,V,t) 2(x,0, 4) (1-3) 
dx Vv * 


For the convenience of discussion let the 
numerator of Equation (1-3) be “9 C2 Uo) : 


5 CE SS —9(%,V,Tb) 
Soa ypi cote ta UF (1-4) 
$ J. d: 
Since U re = aE , Equation (1-4) can be 


written ina slightly different form: 


du 
ot ~ —9(%,Vv,t) (1-5) 


Another relationship at our disposal is that 
(1-6) 


Equation (1-4) defines the slope of a solution 
curve in the wv , % plane, Equation (1-5) defines 
themMslOpemotmam curves ine the 97.7 plane, and 
Equation (1-6) defines the slope of a curve in the 
x ,tplane. Notice that between any two of these 
planes all the variables encountered in Equation 
(1-1) are present. Given the initial conditions, a 
tangential approximation to the solution curve can 
be made in any two of these planes (or all three 
if so desired). 
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Fig. 1-1. Construction technique. 


From Figure 1-1 the basic scheme for ap- 
proximating the solution curves in the various 
pianes becomes clear. 
At t = @ , the numerator of Equation (1-4) 
might be evaluated as -9(%, , Ua, t,) In the 
v,z#plane a perpendicular dropped from the point 
X%» » Up tothe x axis automatically gives a line 
segment whose length equals %. A length on the 
~ axis equaltog(x, , Y%,,) canbe meas- 
ured off from the point x,. The slope of the line 
S,7, is then: 

i ee 
CN ETE BRIA AE: 


° 


(1-7) 


The slope of the perpendicular to the line $,7 at 


Wy , % is the negative reciprocal of the slope 
oF 
1 “G(%_ 9% »%) ea) 
BL Tey 0! ales En be 


Consider Figure l-la. 


This slope satisfies Equation (1-4) and hence a 
short segment of the tangent constitutes a solution 
in the neighborhood of x, and % The end point 
of the short tangent segment will giveanew value - 
of xandv, say ~, and vw . However a new value 
of ¢ corresponding to x, and v;, is required be- 
fore the numerator of Equation (1-4) can be eval- 
uated and the process stated above repeated. 


Since oe ron and ~v% are known, and 
-G C w , Uv, t) has already been evaluated as 
9. Givtiel hts. onto eotequation (1 -5)ecanibesused 
to obtain a tangential approximation to the solution 
curve in the 7, Z@ plane. Refer to Figure 1-lb to 
SeceunOw thissisedone. At the: pointec= anda camed 
perpendicular is droppedanda unit distance meas- 
ured off. Ona line parallel tothe t axis the dis- 
tance g( X%, 7 Uo) 9) to) 1s measured offs which 
gives the slope of the line S, 7) as: 
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Therefore the slope of the perpendicular tothe line 


Say at 7 andat sis: 
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This satisfies Equation (1-5) and hence a short 
segment of the tangent approximates the solution 
curve in the neighborhood of vw, and % 


fo} 

In the x,t plane the story is much the same 
(refer to Figure 1-lc). At the point x, and t a 
line parallel to the xaxisis drawn and a unit dis- 
tance measured off. Ona line parallel tothe t 


axis the distance #% is measured off. The slope 
of the line 7,5, is: 
m ae (1-11) 
3% % 
The slope of the perpendicular to 7 S, at 75 4 
to Sts 
7 
= =v, (1-12) 
m ) 
7335 


This satisfies Equation (1-6) and hence a short 
segment of the tangent approximates the solution 
curve in the neighborhood of %, and ft, 


By drawing parallel lines between the three 
planes one can determine the new values of x, 
wv and ¢ to be used in the next approximation to 
the solution curves. The procedure described 
above is then repeated as many times as neces- 
sary to obtain complete approximations to the 
solution curves in each plane. 


Note that only two planes are actually needed, 
however carrying along solutions in all three 
planes enables one to make judicious choices for 
the lengths of the tangent segments which approxi- 
mate the solution curves. For example, if the 
procedure yields a new value ~, , inthev, x 
plane and ¢#, inthe v,t plane, a construction 
in the x , t plane should yield the same values of 


x andt . If the same values are not obtained, For this special case the work required is 


then the lengths of the tangent segments must be materially reduced since only the % ,wv plane is 
decreased until an acceptable degree of accuracy necessary to construct a complete solution curve 
is achieved. Hence a self-checking feature is (solutions in they,t and x,t planes can be car- 
incorporated in the technique by the use of the ried along for their information content). Notice 
seemingly redundant third plane. that a numerical computation of 4(%,v) is still 

necessary for each approximation to the solution 


The technique described above is an extreme- 
ly simple one, but nevertheless tedious - sincea 
numerical calculation of gf x ,v, t) must be 
made for each tangential approximation to the 
solution curve. Indeed, we may conclude that the Damping Velocity Dependent, Spring 
technique constitutes a numerical solution of EE a a ee eo 
Equation (1-1)* which uses the various planes to 
tabulate the results in an accumulative fashion. 


curve. 


Section 4 
Force Displacement Dependent 


In the sections which follow various special If a(x%,v) —a, b(r,v) — hblv) and ¢(%,v 
cases, which do not require as much numerical —>c(x) Equation (3-1) ida Be 4 to 


calculation, of Equation (1-1) will be considered. 
The special case of most practical importance to 


the engineer will occur when Equation (1-1) is _2) yaar les 
permitted to become "piecewise linear", with #(t) oe a ad (4-1) 
equal to a constant. Sx Vv 
or 
Section 2 
Coefficients Independent of Time Wy _ Ger P exp? *&, (4-2) 
ee eee de U 
If the coefficients of Equation (1-1) are not 
explicit functions of time, the equation simplifies For this special case almost all the tedious 
to numerical work can be eliminated. A curve of 


Div) vs uv * can be drawn as cana curve of 0 Ce) 
vs x .* Therefore, at any particular value of x 
and 27-(say x, and v,),the values Dow) and O7%,) 
can be picked from their respective curves witha 
compass and used to construct the tangential ap- 


AkVIZL + bh(hv)e + C(h,v)Z = F(t). (2-1) 


Using the same change of variable employed 
in Section 1 gives: 


b(,v) C(x,v) F(t) roximation as shown in Figure 4-l. 
dy __a(%,v) aw)” * atau) _ ~ye vt) (2-2) 5 : 
gx Vv = Uv The slope of the line 5,7, is: 
Since the numerator of Equation (2-2) is still UY 
some function of time, no real simplification re- Li EO eh segs ee Oa (4-3) 
sults. Of course, the numerical computation of ¢4 ES On % 
90%, u4r,t) may be considerably easier. = be 


The same sort of situation arises when f (¢) 
equals a constant, but the coefficients remain ex- 
plicit functions of time. 

Section 3 


Coefficients Independent of Time, 


Forcing Function Constant 


When the coefficients are not explicit func- 
tions of time, and #(¢)equals a constant ( &), then 
Equation (3-1) results: 


2160) 5 COV) 1, 
dv _ _&(%,v)_ _al%v) amv) _ “h(%,v) (3-1) 
dx We Vv 


* In this paper we have restricted ourselves to a 

very general second order equation. It is not in- 

tended to imply that only second order’ systems 

can be treated by this technique of employin Fig. 4-1. Construction details. 
convenient relationships between a number o 

planes. Relationships between Bighay order planes 

exist which permit the graphica solution tech- 

nique discussed here to _ be applied to higher 

order systems. An illustration of this is given = pw) and Q@(%) must be plotted to the same 
in Appendix A for a third order system. relative scales as the ~% , w plane. 
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The negative reciprocal is: 


= / = Bop oho: R, 4 4) 
ig ° 


Equation (4-4) satisfies Equation (4-2), hence 
the construction is valid. 


For convenience, one may include the constant 
&, ineither of the auxillary curves (for example, 
plot Ocx)-&, | vs. ~)and eliminate one compass 
measurement. 


Section 5 


Lienard's Construction 


When a(z,v)—>a, b(%,v) > bvJandc(t,v)c, 
Equation (3-1) can be manipulated to read as 


A2EtbW)XK+CH=#& , (5-1) 


Equation (5-1) is a special case adequately 
covered by the discussion of Section4 - however it 
is interesting to re-examine this equation usinga 
slightly different approach. Divide Equation (5-1) 
by ¢ and use the change of variable 


t=Vc/a t (5-2) 
Sk Soe 
oe = \/Cfa (5-3) 
and 
P22 ef eS ae 24 
ade Or ge VEO oe (5=4) 
also 
ioe den there? dv. 3 
ate dt. dt. ot Se Te 1353) 
but 
dy _ id de) _ pa LK 52% 
re ee. gt? =) 
~ I& dx a 
oz = Cle “yre (5-7) 


Substituting Equations (5-4) and (5-7) into 
Equation (5-1) gives 


2 


ES TA ape geist Ree (5-8) 
TTA Fee a ets 
Now, let dz/dt = uv , which yields 
_ sf) 
Pa ae ee 
Be (5-9) 
IX Ce 
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as the phase plane equation. For convenience, let 


re DRS Se a Re (5-10) 
giving 
dv = =a 2 (Sale) 


as the phase plane equation. 


Equation (5-11) is in the proper form for th 
application of Lienard's graphical construction, 
which is perhaps the easiest known technique for 
treating differential equations of the form of 
Equation (5-1). The details of the constructionare 
indicated in Figure 5-1. 


NOTE: THE Y&Z AXES. MUST BE 
PLOTTED TO THE SAME 


Fig. 5-1. Details of Lienard’s construction. 


The curve ~=-p~(vjis first plotted. To deter- 
mine the field direction at any point P(xz,v), the 
procedure is as follows: 


From / alineisdrawnparallel to the x axis 
until it cuts the curve n=-pl)at Rk. From & a per- 
pendicular is dropped to the xaxis at § ; the field 
direction at Pis thenperpendicular to the line SP. 
The slope of the line SP is yet» while av/ox is 
the negative reciprocal ofthe slope SP. Note that 
the sense (as depicted by the arrowhead) is clock- 
wise. 


It follows that Lienard's construction can be 
used to obtain anapproximate solution curve in the 
following way: 


1. At the point selected as the initial point, 
dufdzis determined graphically, as illus- 


trated. 

2. The integral curve inthe neighborhood of 
this point is replaced by a short segment 
of its tangent. 

3. At the end point of this segment the field 


direction is again determinedas outlined 
in steps 1 and 2. 


4. This processis repeated until the com- 
plete approximation to the integral curve 
is obtained. It follows that the approxi- 
mation can be made quite close by keeping 
the length of the segments (depicting the 


field directions) as small as possible. 


The details of the construction lead to the fol- 
lowing restrictions on the phase plane equation. 


ie The coefficient of vy in the denominator 
must be unity. 


(2. The coefficient of x in the numerator 


must be -l. 


3.. The curve % = -Wv) * cannot be multi- 
valued on any line parallel to the x axis 
since the problem arises as to which 
intercept should be used inthe construc- 


tion. 


4. The characteristic phase plane equation 
is 2=-Wlv) . This implies that a char- 
acteristic phase plane equation of the 
form %=- W(%,v) is inadmissible. That 
this is true can be seen by replacing Wr) 
by W(~%v) in Figure 5-1. The point P is 
then dependent on one value of % (for 
example, x, ) while Ris dependent on 
another value of x (for example %p ). 
The construction would then yield 


du -Wn, »U) — ®&, 
Os) 
dr Vl, I ~%, 
rather than SS SS (5-13) 
Sx, Vv 


Hence the construction in invalid. 


The realization of good quantitative results 
with the construction depends only on the length 
of the tangent segments which approximate the 
solution curve. (Assuming that the characteristic 
phase plane curve has been plotted with care.) 
After a little experience with the construction one 
soon discovers that the length of the segments de- 
picting the solution curve, atany givenpoint, must 
become smaller, for any specified accuracy, as 
the slope of the characteristic phase plane curve 
increases. The worst case arises when the char- 
acteristic phase plane curve has, at any given 
point, an infinite slope. Whenthis occurs the solu- 
tion curve is an arc of a circle, which demands 
that the tangent segments have an infinitesimal 
length and be of aninfinite number. As a practical 
matter, the difficulty with infinite (or near infinite) 
slopes can be avoided by swingingarcs ofa circle 
with a compass over regions where the solution 
is determined by the infinite slopes. 


In the following section a technique will be 
advanced to extend the applicability of Lienard's 
construction to second-order physical systems 
which do not have differential equations of the form 
of Equation (5-1). 

* Henceforth ~=-W(z) shall be referred to as the 
characteristic phase plane equation,while the plot 


of X=-W(w) shall be referred to as the chacter- 
istic phase plane curve. 
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Section 6 


A More Generalized Lienard's Construction 


In Section 5, the mechanics of Lienard's 
construction were discussedand the rather severe 
restrictions on the co-efficients of x and yv in the 
phase plane equation were set forth. These re- 
strictions required that the differential equation 
have the form: 


xt+Pi)ru=# (6-1) 

This section describes a modified Lienard's 
construction which permits a more general dif- 
ferential equation than Equation (6-1). 


To begin, assume a differential equation of 
the form: 


LthV)L+¢C(X,VIX=zR (6-2) 


Equation (6-2) yields the following phase plane 
equation: 


yar -biv)u tk -C(L4,VIxX 
dx v (6-3) 


Equation (6-3) is notinthe proper form for the 
application of Lienard's construction. However a 
slight modification in the regular procedure will 
provide a simple geometric technique for effecting 
the solution. Plot, inthe phase plane, the following 
equation: 

x% = -hv)UtR (6-4) 

If the point for which dv/dx% is desired is 
vo) (for example, point P ), then multiply x by 
C(x%,u) to obtain c(z,v)x (for example, point Q ). 
Refer to Figure 6-1. 


Referring to Figure 6-1, it is seen that the 


slope of SQ is: 

— (6-5) 

wre — ——— = 

Cy wep el ee 
du/olx at Q is: 
bry + te —C lt, VU) 
bones @w) ? (6-6) 
ax UV 


This slope satisfies Equation (6-3) andcanbe 
transferred to P. (Since S7 = @P , the slope at 
P can be established directly without performing 
the construction details at Q .) 


For the special case where clv,x) (AGA 1 
a further simplification results. Notice thatQf= 
OWES FAG NAGS), If a plot of x(1-Cl~)) vs % 
is constructed tothe same scaleasthe %,v phase 
plane, then (for any particular value of % ) the 
distance S7 can be added or subtracted with a 
compass. If x(/-Cc(%)lis negative(c(z)>/) , add 
S7 towardthe left. If x(/-c(x))is positive (c(x)<1), 
add S7 toward the right. 


There are no restrictions onthe values which 


x=-bujyrk 


Fig. 6-1. Modified construction details. 


the coefficients of Equation (6-6) may assume. 
(Specifically, the coefficients may even be identi- 
cally equal to zero. This property is especially 
useful in analyzing saturation effects inamplifiers 
and motors.) 


The preceding results were exact. Asaprac- 
tical matter, more useful results can be obtained 
by approximations. Consider the following equa- 


tions: 
A(L,VIL*Fb(L,VIXZtTFC(X,VIXZ=O (6-7) 
or 
ea 4(%,v) . (iG FID 

eo ee 6-8 
“a A2(X%,vV) a(x,vV) % P : 
let 
BOLET on Dex) (6-9) 
amv) 
and 
A2(Z,V) 
then 
Lt DOlb,v)% +E (L,v)% =O (6-11) 

The phase plane equation is then: 

dv —-D(D,VIV-E(2H,V)2% (6-12) 


av Y 


If the variation in D(x%,v) due to xis small 
over a reasonable range of %, then D(x,v) can 
be evaluated at some convenient point within this 
range, say %, (This gives D(x,,v ) 


This process can be repeated over as many 
ranges ofzas are needed to obtain a good approxi- 
mation. Separate characteristic phase plane 
curves arethenplottedinthe z,v plane. The con- 
struction procedure is the same as before, except 
that the choice of the characteristic phase plane 


curve is determined by the particular interval of 
% in which dy / dx is being determined. 


In Section 7, the techniques outlined in this 
section will be applied to the analysis of a non- 
linearity in a high accuracy positional servo- 
mechanism. It will serveasaninteresting vehicle 
to clarify some of the mechanics of actually obtain- 
ing and plotting the characteristic phase plane 
equation in the phase plane. 


Section 7 


Application To A Position Servomechanism 


The preceding section described a general- 
ization of Lienard's construction which, asa spe- 
cial case, handles piecewise linear systems with 
ease. The present section will demonstrate this 
by applying the technique to the analyses of the 
performance of an inertially damped position 
servomechanism with saturation in the forward 
loop. 


The servo under discussion consisted of the 
following principal components: 


1. <A high accuracy error transducer (CX- 
CT pair). 
2. A conventional servo amplifier with 


power output stage operating directly into 
the motor control-field winding. 


A size 18 servo motor. 
4. A viscous coupled inertial damper. 
A 40/1 gear train. 


The physical configuration is depicted in 
Figure 7-1, while the system block diagram is 
given in Figure 7-2. 


DAMPER 


GEAR TRAIN 


NOTE: LOAD IS NEGLIGABLE 


Fig. 7-1. System physical configuration. 


Ky (7a, S41) 
©, EL A AE Seer pills 
name STs StI) TH S41) mals 


Fig. 7-2. System block diagram. 


where: R = input position, rad 
Q = output position; rad 
E = error, rad 


= = motor angular position, rad 

kK, = amplifier gain, volt volt” 

kK, = transformation ratio of 
transducer (CX-CT pair) 

Ge = rad volts feces 

Tae = equivalent motor time con- 


stant, sec 


LAs e7 are time constants intro- 
duced by the inertial damp- 
iey | SEO 

fee = gear ratio between output 
shaft and motor shaft 
S = LaPlace operator 


In this paper the burden of deriving Figure 7-2 
will not be shouldered (Reference 1 contains an 
excellent derivation). It will be assumed that the 
system has been synthesized to satisfy some linear 
criterion, with the values depicted in Figure 7-3 
resulting. 


R 2 ~, 17,800.03 S+1) P=) 
are SC5.4S41)(.002 S+1) is KKK 
k= —2am (sec!) 


Fig. 7-3. Final system block diagram. 


The Bode plot for this systemis givenin Fig- 
ure 7-4. 


-20 D&/decade 
-40 DB/decade 


W 


GAIN IN D& 


Fig. 7-4. System Bode plot. 


It will be necessary to approximate the third 
order block diagram of Figure 7-3 with a second 
order one, since the non-linear technique advanced 
in Section 6 is applicable only to second order 
systems. Inspection of Figure 7-4 makes an excel- 
lent approximation obvious. Thepoleat S=-7/7,4 
corresponds toa gainofapproximately -/5DB  , 
hence it canbe ignored.* This approximation gives 
the block diagram shown in Figure 7-5. 


Consider the case of saturation. In this parti- 
cular servo, saturationinthe amplifier occurs be- 
fore torque saturationinthe servo motor. Because 
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Ky (7g $t1) 


S2 
fs S(Tp5e1) i 


Fig. 7-5. Approximate block diagram. 


of this, the amplifier canno longer be represented 
as aconstant. Replace the constant bya non-linear 
function (4@) in the block diagram, giving Figure 
7-6. 


Ky (7S t1) 
BE Ae tron | 


Fig. 7-6. Block diagram with nonlinear element. 


The non-linear gain function (A(@)) can be 
plotted versus any variable desired** Hence it is 
possible to construct plots of Afe)vs. 0,R or 
(a A plotof A(e) vs. £ will be selected since it 
is desirable in servo work to use an error rate 
versus error phase plane. This particular phase 
plane is convenient because a zero steady state 
error corresponds to the origin of the phase plane. 


If the idealized and normalizedplot of £, vs. 
& given in Figure 7-7 is taken as the transfer 
function from £, to£ , then the block diagram of 
Figure 7-8 can be used. 


UNITY SLOPE 


Fig. 7-7. Idealized saturation curve. 


Note: This particular servo amplifier satu- 
rates for an arc input of eight minutes. 


Fig. 7-8. Normalized block diagram. 


* The effect of the pole at S=-1/] can be investi- 


gated by applying the more general 
ppendix A. 


** This is not always true, 
unity feedback system. 


discussion of 


but here we have a 


When 


= Cie ren A Cejn= 7 
OTK CE St) (7-1) 
nya ees NE ‘ 
ES CTA) 
‘ 2 
{ir aes St Son LL aS eee ee eae (G22) 
OE AT SAG RIT OS + Ky 
or 
TmS E +tK, GSE +K,E = R[F) 5245] (7-3) 


Let S= d/dt and limit & to 4 (a constant). 
] J de 
Tim jez *C1+kKy BITE Sold Ne! (7-4) 


It is convenient to work with ratios of Tn [Kv _ 
since this ratio is essentially a constant. 


Theda freer =: K 
oe p=) # Pe sel =tG (7-5) 
ae, Shy Tas 
an Ky Fy >t (7-6) 
/ 
Im de de 
K, reas tea ome (7-7) 
let t= VK / tm eee & =k, [Ton we 
o% 
or €=\K,/Tn e (7-8) 
This leads to Equation (7-9) 
de 1 de 
<3 *hfk,/t, 7 +e=0 (7-9) 
dt? a v/'m ot 


The phase plane equation is (letting def dt, = Z Me 


> = - EK, /Tn, E-e 
re ein Ln (7-10) 
de 6 


Substitution of the numerical values given in 
Figure 7-5 gives: 


. : 
~ fe. =C 

ge; sO che Bd when -e¢e<e (7-11) 

de é 


7 


When £ > +e (or&<-e€_):£,-in Figure’ 7-8 
is a constant and equal to +e (depending on the 
sign of £ ). 


DCP: 


(7-12) 
S(T S41) 
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and R-@=E 
Auli tl 
R- pavos O17 = (7-13) 
OY PSO ae. 
or 
R( 78745] - te [Ky (GS+1)]=%,57E4+SE (7-14) 
J 
Let Oia ) R= & 
2 
‘ e de 
Im He toe Te Ky =O (7-15) 
To conform to the time scale used in Equa- 
tion (7-11), divide Equation (7-15) by kK, , 
Vins edi@eeil gles 1 
Papers a aki a (7-16) 


It would appear that the generalized Lienard's 
construction cannot be applied to Equation (7-16) 
since the error term is missing. However, as 
pointed out in Section 6, the non-linear coefficients 
may be explicitly equal to zero, which allows for 
the replacement of Equation (7-16) with Equation 
CLEA YE 


ip ipa 

m de (e Sas : 

Mp ek de 90> o£ a 
where g =O 


This gives the following phase plane equa- 
tion: 


dé, re kK /7, as 
de é 
for @€>€,e@<-é (7-18) 
where g=0 


Substitution of the numerical values shownin 
Figure 7-5 gives: 


dé, ~-.00346-ge té me 
POS SETTERS sca $3 


7 


Equations (7-11) and (7-19) will completely 
specify the systems performance in an é, vs. € 
phase plane once the initial values have been deter- 
mined. Notice that initial values are of interest 
here, since our basic equations were derivedfrom 
the block diagram of Figure 7-8, which automati- 
cally makes all initial conditions zero. Todeter- 
mine the initial values when-€< & < € , rewrite 
Equation (7-2) as 


Godan ee era ia ee 9c moe Be au rah [Belg esi; iD Se ee ile. dt one hoe 
foe, ' = = 
aro Oat AT Seal ci eae ee ee pee Bate 2 |37|=]@4| -| el “<2h8 eee Le es: 
aa adh: aaa 
meee SP ie peti a tao te A 
eth | ad: SAMPLE 
| FOR ICONS: | Bea i CONSTRUCTION 
a a Bae wing fecenfenasencefentecne ci penentcnafentnane ee eis ed FOR@>@ 9 4 
: Shiae | pnd fo alta tasonerine 
ee Meee er 
: Seg i ae : 
Se nee come a ae poe g See ae ame gerne ee ree a ie Dake Gat oe if eee pee ab 
| ened LAe | Lala. : : 
Q/ (OES € Oe ein te we 5é 
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oe eae eae faa leaks RS og po a eS 
ee : oe ee ae ie eee 

weds | or | LS 
aa en eae farcnees Bameroma: >.> sas 
| @ = -.0034 6 -e ise he poe TON | | 2k ink ol vel ye ele ieee ORT OTE: 
TG earatereed agen Meat tee [ee ee ae 
: : : H : ; i C i H : : 
| Te i i a Gs a am aad a tL ge 
sls ee ee: BY Or er aE a a eee on a 
focal 2 TAS Ee ee ee ee Pe ach ae mi, OOS, ¢ ee ee ee 
ee ee le ava 
re ee ele eet 2 toe 4 el a re 


Fig. 7-9. Saturation construction. 


RCS? Vigo 
ea 


1+ ky 7a 
[3? + (=F *)5 +3 
m” m 


E(s) = (7-20) 


with R being replaced by &fs. Equation (7-20) can 
be written in the following form:* 


Zine 
E,..=#& ae Kye _ Ky Na Kb Re bes (7221) 
(Ss) Ss: FS I TZ 1a 5? 
or 
7-22 

y} Ky yk Ky Ki Kau” rs 
e = =- - —_- - 7 — —eees 
(¢) pe fa ely BF 


Evaluating Equation (7-22) at t=O gives the 
initial value of e: 


Co) = & (7-23) 


* The form of Equation (7-20) precludes the use of 
the initial value theorem in determining the ini- 
tial value of de/adt . 


Differentiating Equation (7-22) and evaluating 
the result at t=O gives the initial value of de /dt 
as: 


Co) = ~ Aa (7-24) 
But 

on = Tm/ Ky &. ? (7-25) 
therefore 

Cr ee VKi/ Tr (7-26) 


When 4>e (or < -€ ), the same sort of analy- 
sis applied to Equation (7-13) yields 


kz (7-27) 


€(0) = 


e pat 5 i) 
F100) + eh, V Ky In 


The use of Equations (7-10) and (7-18) are 


and 


(7-28) 
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demonstrated in Figure 7-9 for a J€ step input. 
Since €>+€ , Equations (7-27) and (7-28) deter- 
mine the initial values. The tangent segments were 
made relatively large for the sake of clarity in 
following the construction details. In addition, a 
sample construction was carried out, inthe upper 
half plane, to demonstrate the construction details 
Ore PIKE 


Notice that the construction becomes trivial 
for @>€ (or <-€ ), due to the steepness of the 
characteristic phase plane curves. This can be 
seen more clearly by writing Equation(7-19)inan 
approximate form: : 


FE 


s (7-29) 


An inspection of Equation(7-29) makes it clear that 
the basic slope idea advanced in Section 1 works 
very nicely; itis only necessary tomeasure off € , 
in the proper direction, on the @ axis to construct 
the tangential approximation. (Refer toFigure 7-9) 


More generally, with 9 =O, the discussion of 
Section 4 canbe applied directly to Equation (7-19), 
since the numerator is a function of é, only. 


The circled points on Figure 7-9 denote part 
of the solution that would have resultedifthe pole 
at S= aes had not been ignored. 
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Appendix A’ 
A Third Order Differential Equation 


This appendix will consider a third order 


equation, the object being to illustrate the gener- 
ality of the ideas used in Section 1. Consider the 
general third order differential equation 


3 2 
Ax MEE Fe ax 
dt? ct dt 
where A ,8&,C and Dare coefficients dependent 
OnE Cee tan Cand. o: , 


A +8 +Dx =f (t) (A-1) 


#(t) = forcing function 
and @= acceleration 
vy = velocity 
x = displacement 
t = time 
Equation (A-1) can be re-written as follows: 


dx _f(t) 8 d% 


MerLig Able inde "Aadt = 


Chote! 


A x (A-2) 
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Co Fen 7 7 yy eer (A-3) 


For the convenience of the discussion, let the 


right hand side of Equation (A-3) be called 
“9(a,v,x,t ) Then 

da 

Bry by —9(a,vV,%,t) (A-4) 


However, we have additional information at 


our disposal in the form of defining equations: 

dx da? da. da 

ge dt Fae ae eel 
dv a! 

and ae = ’ oe ee (A-6) 


Using Equations (A-5) and (A-6) with Equa- 
tion (A-4) gives equations which can be interpreted 
as slopes in their various planes (for example, 
Equation (A-11) defines the slope of a solution 
curve in the acceleration, velocity plane). 


CU 
SE CE (A-7) 
a =v (A-8) 
ne =~ (A-9) 
fe = -9¢a,v, x,t) (A-10) 
Oa _ 
sg aN Ces 1, t/a (ASU) 
Cle 
SS -9(a,v,x,tY/v (A-12) 


Equations (A-7) through (A-12) can be used, 
as Equations (1-4) through (1-6) were used in 
Section 1, to obtain approximations tothe solution 
curves in the appropriate plane. Figure A-1l 
demonstrates a possible way to set up the various 
planes to make maximum use of parallel lines 
between planes to construct slopes (note that only 
three of the planes are required to construct a 
complete solution). 


A sample construction has been included in 
Figure A-1 to demonstrate the simplicity of the 
scheme, Notice that once 9 (Q),v, ;%., %.) 
has been computed that all the tangential approxi- 
mations can be easily constructed with parallel 


lines and/or a compass. 


It is obvious that even higher order equations 
can be handled in much the same manner; of 
course there will be a comensurate increase in 
the number of planes required as the order of 
the equation increases. 


As in Section 1, constructions in seemingly 
redundant planes will serve to enhance the 
accuracy of the technique. 


uy — ee ee ee a 
% 


AT T=t, 


= Xe 


v= 4, 
2=a, 
79(A,U,%,t)* —9(0) 


Fig. A-1. Construction details for a third order system. 
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ON THE USE OF GROWING HARMONIC EXPONENT! ALS 
TO IDENTIFY STATIC NONLINEAR OPERATORS 


H. J. Lory, D. C. Lai, W. H. Huggins 
Department of Electrical Engineering 
The Johns Hopkins University 
Baltimore 18, Maryland 


Summary 


The following paper describes a method of 
obtaining a polynomial characteristic function for 
a non! ijinear static system. This function, 

F(x) = hx + mx* + dx?, is obtained by the appli- 
cation of a growing exponential x = exp(t) to the 
input of the system and the filtering of the output 
h exp(t) + m exp(@t+) +d exp(3t), into its 
separate components h exp(t), m exp(2t), and 

d exp(3t). The values of these three components 
at t = O are the polynomial coefficients h, m, and 
d respectively. The identification of systems not 
exactly describable by a cubic givesrise to an 
era minimization problem; the technique described 
in this paper minimizes the weighted mean-square 
error, with a weighting function I/x. This method 
is compared with the more widely known sinusojdal 
analysis of nonlinear systems. Experimental 
results are given. 


Introduction 


There has been a growing tendency in recent 
years to regard a given system not as a set of 
physical components, but as a collection of mathe- 
matical operators acting on the input signals to 
give the outputs. This approach, while tending to 
mask much detailed understanding of the internal 
behavior of the system, sharpens insight into 
the transformation of the input signal. Also, 
there is an opportunity for considerable saving in 
the time and effort required to analyze the system. 


To attain this economy, various classes of 
operators suitable for representing systems must 
be established. Even more important to the engi- 
neer, experimental methods must be devised for 
practical measurement of the parameters that 
characterize physical operators. 


This paper discusses an experimental method 
for measuring the parameters of a polynomial 
representation of a static nonlinear operator, 
The method uses a growing exponential input signal 
as a testing function. Because all growing 
exponential signals are eigenfunctions of all 
stable, linear, stationary systems, there is a 
possibility that this method of measuring system 
nonlinearities may be extended to dynamic systems 
as well. However, the present paper considers 
only static systems in which the output at any 
instant is a single-valued function of the input 
at the same instant. 


. In this paper, it will be assumed that the 
system output may be approximated by a polynomial 
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function of the input. The degree of the poly- 
nomial will generally depend upon the nature of 
the nonlinear characteristic and upon the 
accuracy with which It is to be represented. 
many instances, a cubic will provide adequate 
accuracy, and it is this case that we consider 
here. That is, for an input x to the system, the 
output can be represented with sufficient accuracy 
by hx + mx© + dx’. (By proper choice of the out- 
put zero level, the response for x = O may be made 
to vanish). The method is, in principle, appli- 
cable to quartic and higher-degree representations. 
However, the precision required of the measuring 
instrumentation may limit the method to poly- 
nomials of fairly low degree. 


In 


An Ideal Filter for Exponential Components 


Zadeh has pointed out That the basic notion 


of signal filtration is a much more general opera- 
tion than most engineers realize, and that many of 
our common notions concerning the separation of a 
complex wave into its various frequency components 
are applicable to a wider class of functions than 
is generally considered. In particular, since the 
eigenfunctions of all stationary, stable, linear 
systems include the class of growing exponentials 
in addition to the widely used sinusoid, it is 
possible to construct an "ideal" filter for de- 
composing a signal into a sum of a discrete set of 
growing exponentials. 


The ideal filter shown in Figure | for the 
set of growing harmonic exponential components 
exp(t), exp(2t), and exp(3t) has_already been 
described by one of the authors. 


lf an exponential of the form exp(t) is 

applied at t = -oo to the input of a nonlinear 
system characterized by a cubic, the output wil! 
be h exp(t) +m aE + d exp(3t) (Figure 2). 
If this output signal is now applied to the input 
of the ideal filter, h exp(t) will appear at the 
first port, m exp(2t) at the second, and 

d exp(3t) at the third, as shown in Figure 2. 
Furthermore, the three outputs of the ideal filter 
will provide separately the three polynomial 
coefficients, for if each is sampled when the 
value of the input, exp(t), to the nonlinear sys- 
tem is unity (corresponding to the instant 

+ = 0), the values of the three outputs at that 
same instant will be h exp(O), m exp(2+0), and 

d exp(3-0); or h, m, and d, respectively. Thus, 
by applying an exponential exp(t) to the input of 
a nonlinear system, passing the system output 


through an ideal exponential filter, and sampling 
the outputs of the filter at the proper instant, 
one obtains a direct measurement of the coef- 
ficients in the characteristic function that 
describes the nonlinear system. 


Approximation of Arbitrary 


Nonlinear Characteristics 


In the foregoing discussion, it was assumed 
that the system under consideration had a 
characteristic function of the form hx + mx 
What if the characteristic function is not of this 
specialized form? Then, we might stil! obtain#a 
useful representation by approximating the actual 
nonlinear characteristic with a cubic function, 
using some criterion for selecting the "best" 
approximation. Least-squares techniques may be 
applied to numerical data points along the input- 
output characteristic to fit a smooth curve to 
these points. This generally requires the obser- 
vation of many more data points than there are 
parameters to be determined. However, it is also 
possible to use simple signal filtration methods 
to measure directly the parameters which describe 
the "best fitting" curve. In particular, it is 
possible to determine the coefficients of the best- 
fitting cubic approximation to an arbitrary non- 
linear system characteristic by observing the 
response of that system to a single growing 
exponential exp(t). 


3 


+ dx~, 


When the system nonlinearity is exactly 
representable by a simple cubic,the response of the 
system to a single growing exponential input wil] 
consist exactly of the sum of three growing 
exponential terms. As indicated in Figure 2, the 
ideal filter separates these three components so 
that the output signals at the three terminals are 
h exp(t), m exp (2+), and d exp (3+) respectively, 
where it will be recalled that h, m, and d are 
constants in time which characterize the nonlinear 
system. 


If, however, the output of the nonlinear sys- 
tem is given by an arbitrary F(x) when the input 
has the value x, the response of the system to an 
exponential input x = exp(t) will be F (exp(t)] = 
f(+), where f(+) can usually no. longer ‘be repre- 
sented exactly as the sum of a finite number of 
exponential components. However, f(t) can still 
be approximated within some error by the same 
three exponential terms previously used, viz., 


#(+)\ = i es Pe a exp(2t) + oy exp(3t) = t(, 


i] 
where f (t+) is the approximate expression 
obtained for specified values of the coefficients 
h,m,andd. It is clear that these coeffi- 
cients should be chosen so that the discrepancy 
between f(t) and f (+) is small. The choice of the 
h , m', and d' parameters depends upon the par- 
ticular error criterion that is used. We have 
used a uniform weighting of the error E over time: 


E(t) = flew (x) ] 2 ae5 (2) 


and have designed our instrumentation so as to 
yield at any time, +, coefficients that wil 
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minimize the error in a least-square sense over 
the interval -ee<T< +. 


The foregoing discussion has been concerned 
with the curve-fitting of a time function. How- 
ever, our primary interest is to reconstruct a 
cubic in x which is an approximation to the out- 
put F(x) in terms of the input x. 


et iP 
Let x = a Then, =ieo a, 2 = @ 5 lnc! 


=P 


che = © chee se chm Or cr = dx (3) 


i(tyl= Fe F(x) , (4) 
The error integral when expressed as a func- 
tion of x becomes, 


c(o) = [Foo - F'60)] 


' 

{ GZ toes - Ase Be eS he (5) 
x x 

Minimization of the mean-square error in 
approximating f(t) thus leads to a polynomial 
least-square approximation in x with a weighting 
factor I/x. It might seem that a I/x weighting 
factor renders the approximation inappropriate. 
However, this is not necessarily so. One may fre- 
quently require that the relative accuracy of the 
approximation be maintained for signal amplitudes 
that are considerably smaller than the maximum 
amplitude used in determining the approximation. 
The |/x weighting factor achieves an approxima- 
tion that has this desirable property. 


Realization of |nstrumentation 


The most critical part of the instrumentation 
is the ideal filter, since the problem of generat- 
ing exponentials and of simultaneous sampling of 
several analogue voltages is readily solved by well 
known methods. 


Consider now the device shown in Figure 3. IT 
may be constructed using ordinary analogue com- 
puter elements. lf a unit impulse is applied 
+o the input terminal, the respective signals at 
the three output terminals for t>O are: 


#; Sweet aaie, 
J boston Sais (6) 
[6 siigell wahiGent be! dowel Yn 


These signals obviously are identically zero for 
+<0O. 


ne 
MT 


It may be shown” that these signals are ortho- 
normal over the interval from O toe, Knowing the 
impulse response of the filter, one may use con- 
volution to calculate the output eg(t) of the 


output port for any input f(t). 
co, (+) = [iG -2) @leee . (7) 


' 
let t =-T., 


| 


Then (7) becomes 


f (+++) GY (-+ )at’ : (8) 


a 


@) 
x 
— 
—+ 
ad 
| 


Now, consider the time-reversal signals 


2 (+) a Vacca « (9) 


~v 
These functions an are orthonormal over the inter- 
val -e9-0; unlike the original set, they consist 
of growing rather than decaying exponentials. The 
coefticients of the growing exponentials, however, 
are the same. Let us substitute (9) into (8) and 
evaluate at t = 03 we obtain 


c, (0) = [ger yar’. (10) 


This, however, is the generalized Fourier coef- 
ficient of the decomposition of the signal f(t) 
in the approximation 


f(t) = ¢ g (+) =, (+) + C3 G, (+). (11) 


In other words, by sampling the output of the 
above filter at the proper epoch, normally at 
Ft =10, the coefiicients Cys CAseandec-* of the 


2 3 
approximation of the input signal! may be measured 
directly. The orthonormal set {GH} is com- 


posed of the same harmonic exponentials used in 
our previous discussion. Moreover, because of the 
orthonormality of these functions, the approxima- 
tion minimizes the mean-square error. But this 
approximating function may also be expressed as a 
linear combination of exp(t), exp(2t), and exp(3t). 
Hence, the right-hand side of (I!) can be written 

in the form 


he +me + de =¢) ¥ +c, % +3 & (12) 
where 

Y, = 2 5S , 

G = A¥(-20" + 3e°"), (13) 


g; sfOMBet kode he Oe?) me 


By substituting (13) into (12) and equating coef- 
ficients, one obtains h, m, and d in terms of cy), 
Cop and C39 


h = [2-<,- kc, +3f6e, . 
ms = 6c, - 12 J6 c, 6 (14) 
d= 10 a6 C3 , 


Simple weighting circuits may be designed to 
combine the cy, Co» and c_ voltages so as to 


obtain signals that when sampled at t = O wil! 
yield the values of the h, m, and d coefficients 
(see Figure 4). Moreover, the outputs Ri, Ro» 


and R3 will, at any instant +, be the present 
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values of the exponential components of the 
approximation which is "best" in a least-squares 
sense over all past time. The arrangement of 
Figure 4 is thus an ideal filter for the growing 
exponentials of Equation (12). 


Experimental Results 


To generate the set of growing harmonic 
exponentials,an operational amplifier having: the 
Transmittance, _l|_, was used to produce a growing 

s-| 
exponential e . The harmonic exponentials exp(2t) 
and exp(3t) were produced by "squaring! and "cub- 
ing" exp(t) using analogue function multipliers. 
Unfortunately, these function multipliers were 
imperfect and the result of "squaring" exp(t) 
did not yield exp(2t) exactly. Similarly, the 
"cubing" of exp(t) did not yield exp(3t) exactly. 
The ideal filter previously described may be used 
to determine the error of these "squaring" and 
"cubing" operations, as will now be shown. 


Figure 6 shows the result x, of "squaring" x. 
Because the "squaring" operation is not exact, the 
actual nonlinearity may be approximated by a large 
square-law term plus small linear and cubic error 
terms. The values of these error terms wi || 
depend upon the maximum value x_ of the range 
O<x<x_ over which the approximation is made. 
RORMUNShance mak! NGex wml WenmayaEecd athe 
ordinates from the dat& of Figure 6 to find that 


x, = 0.03x + 1,00x- -10,.0e (15) 


Likewise, if the output x3 of the "cubing" device 


is analyzed, yielding the data of Figure 7, it is 
found that linear and quadratic terms are present. 
Over the interval O<x<l, the best fitting 
approximation of the "cubing" characteristic is 
found to be 


ets nO :O1S m4. 0135x140 COx na) 


3 
where the coefficients are given by the values of 
Ry» Ro and R3 ele 24 = lhe 


We may now create an arbitrary non-linear 


device by combining with x the outputs Xo and X3 


of the "squaring" and "cubing" circuits after 
multiplication by constant scale factors. In this 
way, it is a simple matter to synthesize the non- 
linear characteristic 

F,(x) = 0.2x, - 0.6x,, + Ox, (17) 
This has been plotted at the top of Figure 8(A). 
Also shown in Figure {Ais the result of analyz- 
ing F,(exp +). The best-fitting approximation of 


F(x) over the interval 0<x<1! is found by 


measuring the values of Ri» Ry and Rg at x= 1. 
This gives 
F(x} = 0.17% - 0.54x + 0.38x°. (18) 


The fact that the experimentally determined 
Equation (18) does not agree with Equation (17) 


In part, by the fact that the squar- 
|f the 
» as given 


is explained, 
ing and cubing devices were imperfect. 
more accurate expressions for x, and x 


2 3 
by Equations (15) and (16), are substituted into 
Equation (17), we find that the synthesized non- 
linearity should be expressed by 


0.2x, = Wn 220K 
-0.6x,, = -0.018x - 0.600x> + 0.006x> 
+0.4x, = -O.006x + 0.054x" + Q.352x> 


FC), =).0.L76x OWA ae oe 


(19) 
Thus, the discrepancy between (17) and (18) may be 
accounted for by the imperfections in the squaring 
and cubing circuits used. 


In Figure 88) the non-linear characteristic 
has been modified simply by changing the algebraic 
signs of the Xo and x3 components, vize 
F(x) = 0.2x 


+ 0.6x,, - O.4x (20) 


3 


Also shown in Figure 8@)is the result of ana- 
lyzing F,(exp +). The best fitting approximation 
over the interval O<x<! is found, as before, to 


be Bs 3 

F(x) = 507.22 40.5 (x. -20.30x7 . (21) 
Here also, the discrepancy between Equations (8)(20) 
and (21), may be largely explained by the imper- 
fections of the squaring and cubing devices. Sub- 


stitution of Equations (15) and (16) into (20) 
yields 
0.2x =O eOO EX 
| 2 3 
0.6x,, = 0.018x + 0.600x~ - 0.006x 
20 b8 = 006s = 0,059 — 0.35250 


ooo Re OS 


3 (22) 


F(x) = O.20hx + ©;546x" =" 0. 358x 
Next, consider a nonlinearity, such as the two 
line segments shown in Figure 9(A), which Is not 
exactly describable by a third degree polynomial. 
The three component exponentials are shown In 
Figure 9(B). Note that since the nonlinear 
characteristic is |Iinear for inputs between x = O 
and 0.5, only the term x = exp(t) is present in 
this region. For x>0.5, however, the other two 
components are needed to achieve a good approxi- 
mation of the nonlinearity. By sampling the values 


of Ry), Ro» and R3 at x = |, the values of h, m, 


and d are obtained, yielding the polynomial 
approximation. 


F(x) 


The approximation given by (23) was generated 
experimentally and is shown in Figure 10, together 
with the original characteristic function. 

Although the approximation is fairly close through- 
out the interval O<xl, It Is especially good 

near the origin because of the weighting factor — 
in the error integral. x 


0.456x | - 0.086x,, + 0.694x,. (23) 


94 


Compar|son with Sinusoidal Distortion Measurements 


In this section, we consider the relation- 
ship between the measurement of a nonlinear 
characteristic by using growing exponentials, and 
the more familiar harmonic distortion that would 
be produced by this nonlinearity if the input were 
a sinusoid of some specified amplitude, A. 


When a sinusold is applied to a nonlinear 
system, the harmonic components produced at the 
output may be measured individually by selective 
band-pass filters. From these data, the charac- 
teristic function associated with the nonlinear 
system may be determined. 


There are several advantages of using a 
growing exponential as a testing function instead 
of a sinusoidal signal. First, the outputs from 
the ideal filter may be sampled at any instant, 
say at t = to,to obtain an approximation over the 
interval from x = 0 to x oes In a single 
experiment, one may record the quantities Ry» Ro 


and R3 as continuous functions of To: thus obtain- 


Ing an infinite number of best approximations. To 
obtain a similar set of data using sinusoids, one 
has to repeat the experiments at a variety of Input 

amplitudes. Second, to achieve a close fit near 
the origin, the exponentials are much better suit- 
ed than sinusoids because the exponential approxi- 
mation involves a weighting factor | , which 


weights the errors at large amp! itudes less 
heavily than it does at smal! amplitudes; whereas 
the sinusoidal approximation involves a weighting 


AT resis which weights heavily the errors 
I= 


near the peak amp!itude. Third, for representing 
rectifying systems such as diodes, the exponentials 
are much better suited than sinusoids. Since the 
sinusoid will cause the input to vary over the 
range -A<x<A, we must first specify the non- 
linearity for both positive and negative values of 
the input. On the other hand, a growing exponen- 
tial signal has only one polarity, and it Is there- 
fore necessary to make an additional measurement 
usIng a. growing exponential of opposite sign to 


identify the nonlinear characteristic. [It may then 
be expressed over both ranges as 
Ate + ae + ees Os x<! 
Fox) = { he (24) 
hx+mx +dx-, -IlSxs 


where as before, we have chosen a unit interval on 
elther side of the origin over which to optimize 
the cubic approximation, Now the Equation. (24) 
may be used to calculate the harmonic distortion 
that would occur if an input x = sin wt were 
transformed by the nonlinearity F(x). This 
establishes a link between the distortion coef- 
ficients h, m, and d as measured by our method, 
and the more familiar measure of harmonic dis- 
tortion. Because of the quarter-wave symmetry of 
the output of a static nonlinearity, the output 
will have the specialized form: 


a, “ a, sinawt + 23 SanesOeint b, cos 2Ht | (24) Acknowledgment 


A linear relation between these various 
coefficients is given by the matrix equation 


0.000 | -0.042 |-0,125 0.000 | +0,042 | -0.125 
-0.212 | -0,250 | -0.255 0.212 | -0.250 . 


This work was sponsored by the Air Force Cam- 
bridge Research Center, ARDC, under Contract 
AF 19(604)-1941, and by the Office of Naval 
Research under Contract Nonr-248(53). Reproduc- 
tion in whole or in part is permitted for any pur- 
pose of the U. S. Government. 
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Fig. 1. An ideal exponential filter separates a signal 
into its exponential components. 
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Fig. 2. Analysis of the harmonic exponential compo- 
nents produced by a nonlinear system by 
means of an ideal filter. 
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g(t) @p(t) 3 (t) 


Fig. 3. An orthogonal filter. 
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Fig. 6. The analysis of the output x9 of a “squaring” 


Fig. 5. The response of an ideal filter to an input 
xj =e. device when driven by x= et, 
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Fig. 7. The analysis of the output xg of a “cubing” 


device when driven by x = et, 
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Fig. 8. The identification of two nonlinearities F ,(x) and FR). 
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Fig. 10. The polynomial approximation to the broken 
line characteristic of Fig. 9, over the inter- 
val 0<x<1 using F(x) = 0.456x, - 0.086 x5 
+0.694 x3 where the coefficients are the 
values of Rj, Ro and Rg obtained from Fig. 
9(b) at x =1. 
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A PARAMETER TRACKING SERVO FOR ADAPTIVE CONTROL SYSTEMS 
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Summary 


This paper describes one very general 
approach to the design of adaptive control sys- 
tems. The particular systems considered are 
process adaptive. The dynamic characteristics 
of the physical process are determined by the 
parameter tracking servo. The parameters thus 
determined are used to program the process' 
controller. 


The parameter tracking servo is a closed 
loop self-adjusting system. It consists of the 
following elements; 1) the physical process, 

2) the learning model, 3) the adjusting mechanism. 
The learning model and the physical process are 
subjected to the same input signals. Their out- 
puts are compared and the resultant error is fed 
to the adjusting mechanism where some function of 
this error is used to adjust the parameters of 
the learning model. 


The mechanism will continuously track the 
parameters of the physical process as they change 
with time in some unknown manner. The adjusting 
mechanism operates on an approximation to the 
method of steepest descent. These equations are 
derived for a first order process and the over- 
all systems is analyzed. The equations describ- 
ing the tracking servo's operation are both non- 
linear and non-autonamous. System response as 
a function of input signal, gain, and error func- 
tion are described analytically. Experimental 
results are included to demonstrate the validity 
of the analytic solutions. 


Introduction 


An adaptive control system is defined as a 
feedback control system intelligent enough to ad- 
just its characteristics in a changing environ- 
ment so as to operate in an optimum manner accord- 
ing to some specified criterion. The classical 
feedback amplifier which maintains almost constant 
gain in the face of variations in the gain of a 
particular stage may be classified as an adaptive 


This research was supported in part by the United 
States Air Force under Contract No. AF _49(638)- 
438 monitored by the AF Office of Scientific 
Research of the Air Research and Development 
Command. 
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system. In such a system, the adaptation that 
occurs is provided by changes in the feedback 
signal. 


For more complex systems or systems whose 
characteristics change over a wide range simple 
passive adaptation techniques may not be suffi- 
cient.! We will restrict our attention to sys- 
tems which are actively adaptive, and in parti- 
cular to a type which has come to be known as 
process adaptive. A process adaptive system is 
one which determines the values of the signifi- 
cant parameters in the physical process and uses 
these values to program the controller according 
to the specified control laws. 


The physical process must either be indeter- 
minate or vary widely in its dynamic characteris- 
tics as its environment changes to justify the 
use of a process adaptive system. A particularly 
good example of such a process is a high perfor- 
mance interceptor aircraft whose dynamic charac- 
teristics change as a function of speed and alti- 
tude. The use of a process adaptive system then 
makes it possible to design the complete control 
system for a specified requirement without opti- 
mizing the controller parameters for the range of 
dynamic characteristic variation. The parameter 
tracking servo will determine these variations 
and present the "exact" values to the proper com- 
puting circuits for adjusting the parameters in 
the controller. 


Emphasis is placed on the design of the pa- 
rameter tracking servo. Methods for designing 
the controller programmer and the choice of the 
proper control laws are not discussed here. 


The Learning Model Approach 


The particular mechanization described in 
this paper is shown in Figure 1. A learning 
model whose characteristics are as nearly like 
that of the physical process as possible is used 
to program the pre-filter, feedback controller, 
and feedforward controller. The programming is 
done according to the appropriate control laws 
devised by the system designer. 


The learning model is a computer mechaniza- 
tion, analog or digital, whose parameters are 
made available for use in the computing circuits 


of the controller programmer. An example of a 
learning model with a simple analog mechanization 
is that represented by a linear differential equa- 
tion. 


i (1) 

7 dt 

The parameters Q; are adjusted by the adjusting 
mechanism so that the behavior of the learning 
model is as much like the physical process as 
possible. 


The Parameter Tracking Servo 


The physical process is represented by a 
linear differential equation whose parameters 
aj may be considered to vary with time in some 
unknown manner. 


i 
> 74 a .: 


1 


m(t) (2) 


It is important to note that the parameters aj 
are not considered random variables with an 
assumed mean, variance, and/or higher order 
moments. 


The adjusting mechanism which is the heart 
of the parameter tracking servo then adjusts the 
parameter qj to track the a; as the aj vary with 
time. The only information known by the adjusting 
mechanism is the error between the learning model 
and the physical process. 


(3) 


The Method of Steepest Descent 


The parameters @; are adjusted according to 
the gradient of which the ith parameter adjusting 
equation is 


ae Of e) 
dt ‘ Oa; (4) 


If f(e) is chosen to be an even function whose 
minimum exists when the a; = a;, then (4) will be 
satisfied. Any other values of qa, should find the 
gradients non-zero and of the proper sign so that 
the aj are adjusted in the proper direction to 
approach the a;. 


The expression (4) is referred to as the 
equation of steepest descent. If the system is 
a multi-parameter stationary system, then the 
path of steepest descent in multi-dimensional 
Euclidean space is given by: 


dB 
dt 


of 


“¢ 5B, (5) 
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where Bj, Bo, Bz. - By . - B, are the n pa- 
rameters. A rather thorough discussion of the 
method of steepest descent is given in reference 
@. Each of the components of the gradient de- 
termine the rate at which its particular varia- 
ble will change and the direction, positive or 
negative, that it takes. 


To obtain a gradient, however, we must be 
able to describe a surface in the n-dimensional 
space. Unfortunately, f = f(e) is dependent on 
the type of forcing function to the learning 
model and physical process. Therefore, we are 
faced with a surface in n-space which is changing 
continuously as a function of time. Of far 
greater concern is the fact that a zero gradient 
may occur when the aj # a;. A simple example 
exists when m(t) = 0. In this case y = z= € = 0 
and f(e) if it contains no constant term will be 
zero. If we ignore the analytical procedures and 
consider the system from an engineering point of 
view, then whenever m(t) = 0, there is no energy 
to the system and no possibility of any adjusting 
action. Therefore, there must be a forcing func- 
tion for the tracking servo to operate. 


Although no complete surface can be drawn in 
n-space to represent the function f(e), we can 
think of a particular regiof at a particular in- 
stant and determine the change in f(e) as a func- 
tion of the several variables Q), Qo, - - Qi. 

3 (eA 5c Forcing the a; to follow their respec- 
tive components of a derived gradient will be 
shown to cause the proper tracking action. 


Mechanization of the Gradient 


The physical process that the learning model 
must track will be represented by a first order 
differential equation 


dz 


ae + az = m(t) (6) 


The learning model is then described by a similar 
expression 


oS Oy = n(t) (7) 


dt 


Both systems are subject .to the same forcing 
function, of course. Since only one parameter is 
being adjusted only one equation is required in 
the operation of the adjusting mechanism. 


da. 0 f(e) 
dea K da (8) 


Obtaining the gradient of f(e) with respect to 
the variable q@ for a system operating in real 

time is not possible. Some approximations are 
made after a suitable choice of f(e) is found. 


A simple even function for f(e) is 
f(e) = €& (9) 
another which may be tried is 


iG 
Fle) = Hi e& dt 


to 


(10) 


It turns out that (10) leads to an unstable track- 
ing servo with very small values of gain, k. 


If (9) is substituted into (8), we have 


ge 
ut 
—e (11) 


=|8 


-2k ¢€ 


But € = y - z by (4) so that (11) becomes 


da 


i (12) 


re) 
-2k (y - z) eee 
a 


ct 


Note that the 9z/9q = 0 since z is not a functim 


Ome. 


The dy/3a can be approximated in the follow- 
ing ways; first, the approximation can be made 
using the first order terms of a Taylor series so 
that 


hee y(a+ Aa, t) - y(a, t) (13) 
oa A@ 


If an auxiliary equation of the following form is 
used 


dy 
so + (a+ Aa) yy = w(t) (14) 
then (13) becomes 
oy Vie sy 
a 1 
aa Aa (15) 


Aa@ is made a small but constant value in com- 
parison to the range of values q is expected to 
cover. The system of equations describing the 
operation of the parameter tracking servo for a 
first order process are (6), (7), (12), and (14). 


Another approximation of the gradient may be 
found by the following method. For the present, 
consider the parameter q@ constant, then the ordi- 
nary differential equation (7) is exactly equiva- 
lent to the simple partial differential equation 


dy 
ot 


+ ay = m(t) (16) 


Taking the partial derivative with respect to ad 
of (16) 


eye ceeaeny 
da ot da 


+y=0 (17) 


If a is still considered to be a constant valued 
parameter and the Qy/da = u, (17) becomes 


du 
dt 


+ Qu = -y (18) 


Thus far, Equations (16), (17) and (18) are exact. 
If a is permitted to vary, then (18) is only an 
approximate expression and u is only an approxima- 
tion to the gradient 90 y/da. For slowly varying 
systems the approximation is very good. As the 
speed of response of the tracking servo is asked 
to increase, the value of u is less valuable. A 
second set of equations describing the performance 
of the parameter tracking servo will then be de- 
scribed by (6), (7), (12), and (18). 


Performance of the Parameter Tracking Servo 


The second mechanization of the gradient will 
be used in the analysis of the performance of the 
parameter tracking servo. The stability and dy- 
namic response are examined for step inputs and 
sinusoidal inputs. Experimental verification in 
the form of analog simulation runs are also pro- 
vided. 


Step Inputs 


The parameter tracking servo with a step 
input, M, is described by 


z+az=m(t) =M 


+ ay =m(t) =M 


i (19) 
u+ Qu = -y 
G@ = -2k(y - z)u 


Equation (19) can be transformed to a standard 
form by the proper change of variable 


M 
Z= Feely | 
M 
y==—+ 
a 2 (20) 


uaa x 
nie 3 


Equation (19) can then be represented in the form 


x = Ax + f(x) (21) 


where x and x are vectors whose components are 
the transformed members of the individual equa- 
tions in C19)" f(x) is the vector of non-linear 
terms and A is a square matrix of constant ele- 


ments. A is given by 
me 10) 0 
- M 
ee a Ja (20) 
@) -1 -a M/ae 
-2kM/a®  2kM/a2 00 
and f(x) by 
(@) 
SES 


2kx] Xz - 2kxoXxz 


The determination of the stability of the null 
solution of the non-linear equation (21) is due 
to Liapunov+ and Poincare.» Bellman states the 
following theorem and gives its proof in his 
book. § 


If a) Every solution of v= Av 

approaches zero as t —= © 

b) £(x) is continuous in some 
region about x = 0 

e) Hex) /Ix]—~ 0 as [px|| ~ 0 


Theorem 1. 


Then x = 0 is a stable solution of 
(21) 


Furthermore, every solution of (21) 
for which x(o) is sufficiently 
small approaches zero as t —= (©. 


Ill = D4 Pal and (fC = 24 |f,(x)] are 
spoken of as norms. If the characteristic roots 
of the A matrix all have negative real parts, 
then part (a) Theorem 1, is satisfied. The pa- 
remeter tracking servo with m(t) = M has an A 
matrix whose characteristic roots are given by 


k M2 
(1 + a)? (4+ ar+ coccsa 5 }=0 (2h) 
a 
X= -a, -a, -a/2 + j a/2 aS -1 (25) 
a 


As (25) indicates, the parameter tracking servo's 
linearized portion satisfies (a) of Theorem 1. 

On examining (23), f(x) is seen to be continuous 
about x = 0. And finally since f(x) is second 
order while x is first order, (c) of Theorem 1 is 
satisfied. 


103 


Through the use of Theorem 1, the tracking 
servo is seen to be asymptotically stable about 
the equilibrium point x = O which implies q@ = a. 
There are several restrictions to the general 
application of the stability shown above which 
must be pointed out: 

1) An autonamous system has been examined 
since 


a) 
b) 


only step inputs have been considered 


a is considered constant. 
2) Stability in the small has been proved. 
The stability region about x = O has 
not been fully described. 


Though these are serious restrictions which 
must be removed, the steady state stationary case 
must first be proved stable before any further 
discussion of stable tracking action is deemed 
worthwhile. 


The dynamic response of the tracking action 
in the region about the point q@ near a can be 
found from the linear differential equation for 
x,- xX) is the variation of q from a. Using the 
linearized portion of (21) since f(x) is small 
near the null solution and solving for x) 


i : Ok Me 

x) + ax, + ERP: Fi x), = 0 (26) 
and 

a 
x(o) Puri aees : 

xpos e sin wt (27) 

where 
Satara. F Sk_M oat 
reg *e! 


Figure 2 gives the root location as a function of 
gain for the tracking system. It is seen to be a 
conventional root locus diagram for a second order 
system whose open loop poles lie on the real axis. 
The pole at the origin is due to the integrating 
action of the adjusting mechanism. The other 
pole is located at the root of the physical pro- 
cess -a. 


Actually the variation equation pertains over 
a considerably larger region than was ex- 
pected. Computer data for initial offsets of 
@ = Qp at t = ty illustrate behavior of an almost 
linear system. Figure 4 describes responses for 
an offset of GQ) = 2.0 and gain variations from 


0.25 to 5.0. Figure } describes the result for 
varying initial offsets and a constant gain. In 
Figure } the non-linear response is evident. Note 


however, that the terminal response is about the 
same. 


It is important to note that the speed of re- 
sponse is directly dependent upon the value a. 
It should, of course, be expected that a faster 
physical process will give rise to a faster 
tracking servo. Figure 5 gives the root location 
for a 0.7 damped system with a unit step input 


and- the value of k as a function of root location. 


As can be seen higher gains are required for 
faster systems. On examination of (26), the 
effective gain is modified by the value of a7). 
The faster the process, the larger the value of a 
and the smaller the effective gain 2kM“/a’. 


In all the equations describing the response 
of @, or more exactly its variation x), the gain 
k and the mepotcade of the step M appear to- 
gether as . This is really as it should be 
since the energy for operating the system is de- 
rived from the input, m(t). Without an input 
signal, m(t), as previously noted, the system 
would be dead. The signal level m(t) can be 
considered as the square root of the energy in 
the system and it may be desirable to vary the 
system gain k inversely as the .fm(t) to keep 
a desired response for the parameter tracking 
servo. In addition, since @& a is available in 
the learning model, the speed of response of the 
parameter tracking mechanism may be kept in a 
desired range by making k a function of a>. 


Sinusoidal Input Signals 


One objective of the design of this parameter 
tracking servo is to obtain stable response no 
matter what the form of the input m(t). In fact 
a most happy situation would exist if @ could 
track a with little or no error independent of 
the input signal waveform. Since no general 
theorems exist guaranteeing the asymptotic sta- 
bility of x, for general bounded inputs m(t), it 
behooves us to attempt to study the effect of 
as general a class of inputs as possible. Sinu- 
soidal inputs probably fit the category of a 
general input best. In fact, it is to be ex- 
pected that a periodic waveform will give much 
more of a stability problem than an aperiodic 
waveform. There is always the problem of induced 
resonance effects. 


It was previously observed that in the event 
of a step input, the system was always stable no 
matter how high the gain or how large the step, 
providing of course that the physical process is 
stable, a> 0. Is this necessarily true of an 
m(t) = Mj sin wt? It turns out that the system 
is not only sensitive to the magnitude of the in- 
put, but also to the frequency of the sine wave. 
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The equations (19) with m(t) = M, sin wt 
and 

Za 

y=%X) 

(28) 

u= x2 

Q= a+ X)) 
becomes 

xy =7ax, + M, sin wt 

X = -AX%> - Xp Xz t+ M, sin wt 

: 2 (29) 

Xz, = -X_ - aX, - 5%, 

x), = 2k ua - 2k XX, 


These equations can be written in the following 
vector notation 

x = Ax + f(x) + M(t) (30) 
where the components of the vectors and matrix 
are as in (29). 


If an attempt is made to solve (29) for xi, 
the following differential equation obtains 


X), + Pa x), + Xx), - ek XQXzX), 


= 2k Xo (Xp - x;) (31) 


In examining the stability about the equilibrium 
point @ = a or x), = O, second order terms may be 
neglected. (31) then becomes 


x), + 2a k, - ek XxX) = 2k Xo (%5-%, ) (32) 
If x, is very close to zero, X5 = x ,, and the RHS 
of (42) is very small. xp and xz can now be con- 
sidered time varying quantities provided x, «< lL. 
If m(t) is 


m(t) = M, sin (wt + ¥) (33) 


then 


M 
x,(t) = 7 : ac; s~ sin wt (34) 


and 


() ~2 (ot - ¥) 
x = = si t - 
5 ae t ie tm \® Vv (35) 
*. SP) ld 
where yy = tan = 
vo ( ) 
XpXz = - Wiese: sin wt sin (wt - y 
3 Con wy? 2 
(36) 
XoXz = - vo [eos vy - cos(2wt VJ 
= ate lenIs fay - - 
3 o(a2 + a2)!” 
(37) 
where 
cos = 2 


(a@ + we) t/2 


on using (35) in (32) and letting RHS = 0, (32) 
becomes 


: ak M @ 
Xy + 2a x, + Pn 
ie a 
(38) 
k M,° 
= ia bran graye oe (2wt = v} Xx) = 10) 
a’ + ay 


(38) will be recognized as a Mathieu equation 
with a damping term. > It can be transformed 
to a standard Mathieu form by the following 
transformations 


7p atin (39) 

and 
-(>)r 

els y (40) 
(38) then becomes 

ae 

“FE +{a - 2q, cos (2t - v} y= 0 

dt (41) 
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where 
ak Mee ae 
a; = (42) 
we (a? ie we) ae 
kM,° 
qi = (43) 


The solution of (41), the standard Mathieu 
equation, can be stable, periodic, or unstable. 
We are particularly concerned if (41) results in 
an unstable solution. The form of the unstable 
solution of (41)-is 


y = eM Biz) + e YT G(-7) (4h) 


where is a positive constant determined by aj 
and q, and @(t) is a periodic function. The 
solution of (38) is actually our true concern and 
it is given by 


Sie ritagney (oon) 

x =e g y=e ~ ie 
(2 (45) 
-(— +p) 

+e © gb( -t) 


As long as a > w the system has a stable singu- 


lar point @= a. is related to a, and q in a 
very difficult way. Figure 6 describes the re- 
gions of stability and instability of (41). 
Figures 7, & and 9 show a detailed set of iso -p 
lines for the first three unstable regions. 


A particular case was taken to illustrate 
the validity of approximations made above in 
examining the equilibrium of the system subject 
to sinusoidal signals. The following conditions 
were chosen 


B=n ls. 0) 


m(t) =4/5.,sin et 


for which —->|u|, 1/2>|y| is the stability 
condition. igure 7 shows that for the following 
gains the value of will be as shown in Table I. 


TABLE I 
k ay q) Lb 
5 0.0 "28 stable 
10 On25 ~ 56 stable 
UG 0.50 8h -O0.4 stable 
V5 0.625 .98 -0.49 borderline 
20 On Wake -0.56 unstable 


Experimental verification of the predicted 
results was obtained with the use of an analogue 
computer. Figure 10 describes the response to 
gains of k = 10 and 20. Periodic oscillations 
may be observed in the computer runs even in the 
stable case, k = 10. It should be recalled, 
however, that the RHS of (38) is not necessarily 
exactly zero if xo # xX, and that there are non- 
linear terms which have been ignored on the basis 
that the response x) remained in a small region 
-about x) = 0. 


A comple tely satisfactory response can be 
expected if a suitable choice of k is made. 
Figure 11 describes the response of q@ with an 
initial offset and a sinusoidal input signal for 
gains of k = 1 and 4. In these runs w = 2.0. 

A set of runs was also taken for various fre- 
quencies of the sinusoidal input signal. Figure 
12 describes the response of q@ for an initial 
offset. In all these cases the amplitude of the 
sinusoidal input signal was so chosen that the 
magnitude of the sinusoidal output of the process 
was unity. The same effective gain kM,2/(a® +a) 
then pertains to all the runs in Figure 12. 


Tracking Capability of the Learning Model 


The ability of the parameter q to follow 
the process parameter a was tested under the 
following conditions. Both the model and process 
were subjected to a constant step input, 

m(t) =M-=1. The parameter in the process was 
made to vary in a sinusoidal manner with time 
about a mean value so that 


a(t) = a, + a, sin at (46) 


fe) 


The analogue com- 


where a, = 2.0 and a; = 0.25. 
Al- 


puter was mechanized to perform these tests. 


though the parameter tracking servo is non-linear 


in its operation, the system is operating in a 
small enough region about a, to be considered 
quasi-linear. Under these conditions, therefore, 
a frequency response test was made. 
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For the gains k = 8, 20, and 40, Figure 13 
gives the frequency response in db. The varia- 
tion equation (26) for a = a, and the gain as 
above give a damping ratio & = .7, .45 and .316, 
respectively. Curves for a linear stationary 
parameter system are drawn in Figure 14 for com- 
parison. 


The ability to track a(t) in what is really 
a positional tracking servo and not a velocity 
tracking system is dependent on the root location 
of the variational equation (26) for a = ag. The 
higher the gain the greater the bandwidth and the 
better the tracking capability. 


Conclusions 


A particular form for a process adaptive 
control system has been suggested. This form 
makes use of what we call a Parameter Tracking 
Servo. The parameters to be tracked are the co- 
efficients of the physical process differential 
equation. The tracking servo utilizes a learning 
model whose parameters are adjusted in such a 
manner that the model and process are as much 
alike in their dynamic behavigr as possible. The 
criterion for similar behavior of the model and 
process was taken to be the minimum value of ee. 


The ability of a first order model to track 
a first order process has been demonstrated. If 
the over-all feedback control system were to have 
a bang-bang actuator, step input signals would 
provide a sufficient test of the tracking servo's 
capability. In the more general case, for quasi- 
linear operation, the input signals will either 
be damped sinusoids or damped exponentials. For 
this case, the input signals were made sinusoids 
and under these rather severe conditions the 
tracking servos capabilities have been analyzed. 


This work is but a start on what is felt to 
be a very general approach to the problem of 
process adaptive control systems. A r@ort of 
research extending this work to higher order sys- 
tems and to complete feedback control systems 


will be presented in the near future. 1° 
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FIG. 3. THE RESPONSE OF a WITH AN INITIAL 
OFFSET AND m (t) = 1.0. 
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FIGURE 4 THE RESPONSE OF a WITH VARIOUS INITIAL OFFSETS 
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FIGURE 5 AO.7 DAMPED SYSTEM FOR VARYING a WITH A UNIT STEP INPUT 
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FIGURE 6 STABILITY CHART FOR THE MATHIEU EQUATION 
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fil Gamera ISO-p CURVES IN THE FIRST 
UNSTABLE REGION. 


FIG. 8 JISO-p# CURVES IN THE SECOND 
UNSTABLE REGION. 
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FIG. 9. ISO- CURVES IN THE THIRD UNSTABLE REGION 
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FIG.12. THE RESPONSE OF a@ WITH AN 
INITIAL OFFSET AND A SINUSOIDAL 
INPUT SIGNAL FOR VARIOUS 
FREQUENCIES OF THE SINUSOID. 
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University of California 
Berkeley, California 


Summary 


Maximum effort control is a method of 
achieving deadbeat response for a step input to 
an undamped second order element (two poles on 
the jw axis of the s-plane) which is preceded 
by a saturating amplifier. This method of con- 
trol supplies the maximum available energy to 
the element being controlled, by driving the 
amplifier to saturation whenever an error is 
present. The realization of a maximum effort 
control system for an oscillatory element is 
found through a phase plane analysis of the 
equations of motion of the oscillatory element. 
The control system topology is also found by 
the analysis of a phasor representation of the 
transients introduced in the oscillatory element 
by the output of the saturating amplifier. 


The system was constructed to compare the 
experimental responses of step inputs and load 
disturbances, to the responses obtained from an 
idealized mathematical model of the system. The 
adaptability of the control system was tested by 
using it to control a damped oscillatory element. 


The system described will be an aid in the 
design of the control system which will give 
optimum response for random inputs to a undamped 
second order element which is preceded by a 
saturating amplifier. It also provides a method 
of control for systems inh which it is impossible 
to damp poles near the jw axis. 


Introduction 


Maximum effort control of a system which 
has saturable components is more effective than 
linear control of the same system. When linear 
control is used, any saturation that occurs dur- 
ing system operation reduces loop gain. Reduced 
loop gain degrades system performance by decreas- 
ing the accuracy and speed of response. In con- 
trast, maximum effort control drives a component 
to saturation whenever any error exists. This 
mode of operation utilizes the maximum available 
power to correct errors in the system output, 
-thus giving fast response, while the accuracy of 
the output is determined by the open loop gain 
which exists when there is no saturation. The 
design of a maximum effort control system‘ is 
essentially the design of a computer which will 
drive the saturating device in such a manner that 
error is reduced to zero in the minimum possible 
time. 


The design of a computer for the control of 
an undamped element is approached through a 


study of the step response of the element. This 
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is made possible by assuming the amplifier (the 
saturating device) has infinite gain. With 
infinite gain in the linear region of the ampli- 
fier, the output of the computer (the control 
function)! need only be a function that has the 
sign of the amplifier output which should be 
applied to the oscillatory element. (The ampli- 
fier output will have only two levels, positive 
saturation, and negative saturation.) The prob- 
lem in the design of the computer now becomes 

one of finding the sign and duration of the steps 
of force which are applied to the oscillatory 
element. Three steps of force are necessary to 
obtain deadbeat response. For example, if a 
small positive step input is applied to the systen, 
the computer output should first be positive, 
then after a short duration of time negative, and 
after another duration, positive again. The 
resultant amplifier output first forces the out- 
put of the oscillatory element to follow the 
system input, then subtracts energy from the 
element to prevent overshoot, and finally pro- 
vides the necessary output level to make the 
error zero. Since the oscillatory part of the 
step response of the undamped element is sinusoi- 
dal, it can be represented by a phasor. If the 
three phasors representing the effect of the three 
steps of force applied by the amplifier have the 
proper timing their sum will equal zero. This 
represents deadbeat response. The system switch 
curve is found by relating the timing of the 
steps of force to error and error derivative. 

The locus of points in the phase plane at which 
the force applied to the oscillatory element is 
reversed is called the witch curve. The switch 
curve is also found through a study of optimum 
system operation in the phase plane. 


The design of the computer is found through 
an interpretation of the shape of a trajectory 
in the phase plane. A trajectory is a represen- 
tation of the equation of motion of the oscilla- 
tory element in terms of error and error deriva- 
tive. 


The system was set up on an analogue compu- 
ter to observe the effects of the idealizations 
used to simplify the system design. It was found 
that low gain in the saturable amplifier degrades 
system performancee To improve the system per- 
formance, the effective gain of the amplifier was 
increased by the use of positive feedback. The 
system response was also observed when the oscil- 
latory element was critically damped. 


System Description 


Configuration 
The control system is built around two 


unalterable components, a saturating amplifier, 
and an oscillatory element. The oscillatory 
element has a pair of poles on the jw axis of the 
s-plane and unity d-c gain. The control system 
is a computer which drives the saturating ampli- 
fier. The inputs to the computer are the system 
input (r) and the system output (c). A block 
diagram of the system is shown in Figure l. 


Response 


The system is designed to give deadbeat 
response for a step input, and to reduce the 
error caused by it to zero in the minimum possi- 
ble time. Deadbeat response occurs when the 
error, and all its derivatives become zero at the 
same time. 


Idealizations 


In the design of the computer, the gain of 
the saturating amplifier is considered infinite 
in its linear zone. This limits the output of 
the amplifier to its saturation limits. Also, 
it is assumed that the saturation levels are 
identical. The saturation levels are normalized 
to +1 and -l. 


Computer Design 
Computer Output 


A method of determining the computer output 
is to find an input to the oscillatory element 
that will give a deadbeat response. This response 
must have the same final value as the system 
input to make the final value of the error zero. 
This is necessary because the d-c gain of the 
oscillatory element is unity. Figure 2 illus- 
trates the output the saturating amplifier must 
have for a given step input. The amplifier out- 
put required when there is no error (t<0, t>tj 
+ to) is obtained by a very high frequency oscil- 
lation of the computer output, which drives the 
amplifier between negative and positive satura- 
tion. The d-c level of the amplifier output is 
the average value of this oscillation. The step 
durations, tj and to, are determined from a 
phasor representation of the transients produced 
in the oscillatory element by the amplifier 
output. 


Phasor Solution of Switching Times 


Referring to Figure 2, it is seen that the 
amplifier output consists of three steps. Since 
the oscillatory element is linear, the output 
of the element is the sum of the three step 
responses. The magnitude of the first step is 
(1 - a), the magnitude of the second is 2, and 
the magnitude of the third is (1 +b). 


Response to step 1: 


1-a- (1- a) cos ot (1) 


Response to step 2: 


- 2+ 2 cos o, (t - t,) (2) 


Response to step 3: 
derbi b)ecosee (tt = 6) (3) 


The sum of the constant terms equal the step in- 
put (b - a). The sum of the sinusoidal parts of 
the response must equal zero for a deadbeat 
responsee This condition can be satisfied by 
choosing the proper values for t, and t,. Fig- 
ure 3 (a) shows a phasor represefitation©of the 
sinusoidal parts of the step responses. Figure 

3 (bv) shows the vector addition of these phasors, 
with t) and to (61 and 95) chosen to produce a 
sum of zeroe Since the angle @ is directly 
proportional to the first switching time t, this 
time can be found from the phasor diagram and 
interpreted in terms of error and error deriva- 
tivee The locus of points in the phase plane at 
which the first reversal of the amplifier output 
takes place is called a switch curve. 


Switch Curve from Phasors 
From Figure 3 (b): 

l-a+(l1+b) cos ®, = 2 cos 6, (4) 

2 sin @, = (1 +b) sin 6, (5) 

Solving for @ by squaring equations () and (5) 
and combining them to eliminate 95: 

gos Oath ere) tli (1s bY (6) 

(1 - a) 


To convert the first switching time into values 
of error and error derivative, the error and 
error derivative at t, must be computed. At 
time t,: 


e=r-c (7) 


where: r = system input, and c = system output 


r=b (8) 

c =1- (1-4) cos ®) (9) 

e=b-—1+ (1-4) cos 9%) =b-1+ (1- a) 
cos ot) (10) 

é 

—— (a - 1) sin ®%) (11) 


n 


Substitute equation (6) into equation (10) and 
simplify to obtain 


2 2 


4 


Substitute equation (6) into equation (11) to 
obtain 


Bre (a —1) sin cos’ cairo ete CEE) a)*+ b= (2 +0) 
“n (1 - a) 
(13a) 
or 
6 _ _ V6 (a ~ a)? - [fa - a) ~ (246)? 
* 4 (13) 


Eliminate the variable a between equation (12) 
and equation (13b) and solve for @ to obtain 


© 
n 


Sie Ay e* (1h) 
@n 


Equation (1) is the solution for the switch 
curve for positive error at t = 0+. A similar 
derivation can be used for the case with negative 
error at t = 0+. For negative initial error: 


=\/- 2e - 2be - oe (15) 


S |e 


n 


A general form of equations (1)) and (15) which 
is valid for either positive or negative initial 
error can be found by inspection. Replacing b by 
r, the general form is: 


— =-— \/2 lel + 2er- e (16) 


Equation (16) is a solution for the switch curve 
which is valid when the system input does not 
exceed the saturation levels of the amplifier, 
and when the quantity under the radical remains 
positive. The switch curve is recognized to be 
two semicircles of varying radii in a phase 
plane with error and normalized error derivative 


for axes. The effect of the system input on the 
radii of the semicircles is shown in Figure h. 
The phasor approach gives a switch curve which is 
correct for step inputs; however, load distur~ 
bances may create errors of such magnitude that 
the system is forced to operate outside of the 
regions with a semicircular switch curve. Ex- 
tensions of the switch curve to this region are 
found through a study of the system response in 
the phase plane. 


System Response in the Phase Plane 


Description of Phase Plane. The coordinates 
of the phase plane, used for the computer design, 
are error and normalized error derivative. The 
trajectories followed by the equations of motion 
of an undamped oscillatory element are circles 
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centered at é equal zero, and e equal to the d-c 
level of the error. (The d-c level of the error 
is equal to the system input minus the amplifier 
output.) The direction of movement of a point 
on the trajectory is clockwise, with the angle 
formed by the moving point, the center of the 
circle, and some reference point, proportional 
to time. The radius of the trajectory is depen- 
dent on the initial conditions (e, é at t = 0). 


Optimum System Operation. Bushaw" has 
proved that for certain initial conditions, a 
maximum effort control system containing an os- 
cillatory second order element can have its 
error and error derivative reduced to zero in 
two trajectories (minimum time possible). Other 
initial conditions may require three or more 
conditions. All initial conditions which pro- 
duce trajectories which cross the semicircular 
regions of the switch curve can be reduced to 
zero in two trajectories (one reversal of the 
amplifier output). 


Phase Plane Approach to the Switch Curve. 
The mathematical solution for the switch curve 
can be justified by applying the criterion of 
optimum operation (two trajectories) to the system 
responsee The method of justification chosen is 
to derive a switch curve that gives optimum re- 
sponse by observing the response of the oscilla- 
tory element to step inputs, and comparing this 
switch curve with that obtained mathematically. 


The origin of the phase plane is a point at 
which error and error derivative are zero. This 
condition is fulfilled when the input equals the 
output (r = c), and the output derivative equals 
zero (¢ = 0). (For r(t) a step input.) There- 
fore the output of the amplifier must equal the 
system input for the error to be zero. (The 
oscillatory element has unity d-c gain.) 


During the system response to a particular 
step input, only two levels of d-c error are 
available. They are the input signal minus the 
level of positive saturation (r - 1), and the 
input signal minus the level of negative satura- 
tion (r + 1). Therefore, all trajectories will 
be centered at either e =l+r, ore =-lt+r. 
(Trajectories are centered on the error axis at 
the d-c level of the error.) The only mode of 
operation which results in zero error and zero 
error derivative at the end of two trajectories, 
is one in which the second trajectory passes 
through the origin of the phase plane. Since the 
centers of the trajectories are known, and a point 
on the second trajectory is known, the second 
trajectories are defined.e The only way to enter 
the second trajectory is to reverse the amplifier 
output as the first trajectory crosses it; thus, 
the second trajectory is also the switch curve. 
The switch curve is still not completely defined. 
Still to be found are, the location of the switch 
curve when the first trajectory does not inter- 
sect the trajectory which passes through the 
origin, and the portion of the trajectory which 
passes through the origin that should be used as 
a switch curve. The switch curve is chosen so 


that minimum time is used in reaching the origin. 
The construction in Figure 5 shows that the parts 
of the second trajectories in the second and 
fourth quadrants should be used as switch curves. 
A similar construction can be used to show that 
the switch curve follows the error axis when the 
first trajectory does not intersect with a tra- 
jectory which passes through the origin. 


This switch curve is identical to the one 
obtained through the phasor presentation of 
system action. In addition, through the phase 
plane study, the switch curve is defined for the 
entire phase plane. The design of the computer 
is found from an examination of the switch curve 
and its equation. 


Realization of Computer 


Consider the phase plane to be split into 
two sections by the switch curve. If the ampli- 
fier output is positive in the upper portion of 
the plane, and negative in the lower portion of 
the plane, the trajectories from any initial 
value will converge to the origin of the plane. 
To create these outputs, the computer must pro- 
vide a positive signal when the input, error, 
and error derivative signals indicate the trajec- 
tory is in the upper portion of the plane, and a 
negative signal when the trajectory is in the 
lower portion of the plane. As an example of 
system operation, assume a step input identical 
to that of Figure 2 is introduced to the computer. 
This initial condition places the first trajec- 
tory in the upper portion of the phase plane; 
therefore, the amplifier output is positive. 
a duration of t,, the trajectory intersects the 


switch curve, the amplifier output changes sign, 
and the second trajectory is entered. The second 
trajectory reaches the origin at t = + toe 


At the origin, the amplifier oscillates between 
its saturation limits at a very high frequency. 
The average value of this oscillation is equal to 
the system input. 


To obtain the computer design for the semi- 
circular regions of the switch curve, the equa- 
tion for the switch curve (16) is modified as 
follows: 


Multiply equation (16) by its absolute magnitude 
to obtain 


ab --< (2lel +2 er - e*) (17) 
n 
expand equation (17) and rearrange to obtain 


an 2e +g (2 er -e°) = 0 (18) 


© 
n 


A device performing the operations indicated by 
the left side of equation (18) is used as a 
computer because the left half of equation (18) 
is positive in the portion below it. This com- 
puter produces a switch curve which is composed 
of two semicircles, and the dotted extensions to 
them shown in Figure }. The proper switch curve 
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After 


outside of the semicircular regions is the error 
axis. To force the computer to follow this por- 
tion of the switch curve, the term 


e 


ai (2 er - a) + 2e 


is made equal to zero by limiting the output (c). 
A block diagram of the computer is shown in 
Figure 5. In the computer, the term 


e 2 
lal (2 er-e’) 
is replaced by |r - c|(r + c) ase 


iQ 2 er - e°) = lr = cl(r + c) (19) 


The system input (r) is clipped to the saturation 
levels of the amplifier because it is impossible 
to make the d-c level of the oscillatory element 
exceed these limits. The variable level clipper 
in the feedback path from the system output (c) 
forces the switch curve to follow the error axis 
outside of the regions where the switch curve is 
semicircular. 


stem Operation 


The system was set up on an analogue compu- 
ter. This made it possible to study the effects 
of non-infinite gain of the linear zone of the 
saturating amplifier. The responses to step 
inputs and load disturbances were observed. 


Effect of Low Gain. When the gain of the 
saturating amplifier is not infinite, forces 
(amplifier outputs) smaller than the saturation 
levels of the amplifier occur when trajectories 
near the switch curve. This occurs because the 
computer output goes through zero as the trajec- 
tory crosses the switch curve. As a trajectory 
approaches the switch curve, a steadily decreas- 
ing force is applied to the oscillatory element 
once the amplifier is no longer saturated. When 
the trajectory crosses the switch curve, the force 
is reversed and increases as the trajectory moves 
away from the switch curve. The trajectory becomes 
concentric to the switch curve when the amplifier 
saturates. Since the trajectory does not coincide 
with the switch curve, it does not pass through 
the origin. The result is degraded system perform- 
ance. Figure 7 illustrates the effect of gain on 
the system performance in the phase plane. Figure 
8 shows the system response to a step input with 
an amplifier gain of five. These responses show 
that high gain gives superior performance. To 
improve system performance when the amplifier 
gain was low, positive feedback was placed around 
the saturating amplifier is shown in the phase 
plane in Figure 7, and versus time in Figure 9(b). 


Response to Load Disturbance. The system 
response was also observed for step load distur- 


bances which were larger than the available error 


correcting forces. In these cases, the system 
requires more than two trajectories to remove 

the energy due to the load disturbance from the 
oscillatory element. The load disturbance. re- 
sponse is shown in the phase plane in Figure 10(a) 
and versus time in Figure 10(b). 


Application of the Computer to a Damped 
Oscillatory Element 


The adaptability of the computer as designed 
above, to a damped oscillatory element (one with 
two complex poles in the left half s-plane), was 
found by observing the system response. To test 
the computer, variable damping was introduced 
into the oscillatory element while the undamped 
natural frequency (length of the radius to the 
complex poles in the s-plane) of the element was 
kept constant. The damping was varied from zero 
to critical. For damping between C and 0.1, the 
response of the undamped oscillatory element 
(within the accuracy of measurement). For an 
amplifier gain of 50, and damping between 0.2 and 
1, the rise time of the response to step inputs 
was within ten percent of the theoretical rise 
time for minimum time deadbeat response. The 
rise time can be decreased with some increase in 
overshoot by decreasing the gain in the error 
derivative channel of the computer. See Figure 
i. 


Mode of Operation. The proper switch curve 


for a damped oscillatory element is a distorted 
logarithmic spiral. The semicircular switch 
curve gives a good response, because in the oper- 
ating range it approximates the spiral. To 
achieve better response, the gain of the error 
derivative channel was decreased, changing the 
shape of the switch curve to two semiellipses. 
The semiellipse is a closer approximation to the 
spiral than a semicircle. The semielliptical 


Load 
Disturbances 


System 
Output 


2 
@n 


Saturable 
Computer ay eae 


Fig. 1. Maximum effort control system, 


Positive Saturation (+l) 


Negative Soturation (-I) 


Fig. 2. Amplifier output for maximum effort control 
of a step input. 
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switch curve makes the computer change sign later 
than the semicircular curve; therefore, the ampli- 
fier output drives the oscillatory element closer 
to zero error before it reverses. This causes 

the output of the oscillatory element to have a 
faster rise time, but increases its overshoot. 


Conclusion 


Presented is a method of design and a design 
for a computer to control the output of a 
saturating amplifier which drives an oscillatory 
element. The method of design uses phasors to 
represent the transient behavior of the step 
responses of the oscillatory element. Phase plane 
techniques are demonstrated in the development of 
the nonlinear computer used to control the output 
of the saturating amplifier. 


The design presented could be used as a 
starting point for the design of a system with 
random inputse It also provides a useful system 
topology for the control of an oscillatory element 
which cannot be damped. One possible application 
of this system would be in the control of phugoid 
low frequency oscillations in the pitch axis of 
an aircraft. 
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Fig. 3. (a) Phasor representation of transients 
introduced in the undamped element by the 
amplifier output shown in Fig. 2; (b) vector 
addition of the phasors in (a) to obtain the ty 
and tp necessary for deadbeat response. 
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Fig. 4. Switch curve for undamped element. Fig. 5. Construction to find the minimum time path _ 
(r = system input) for a point on the first trajectory to the origin. 


The time spent on the second trajectories is 
proportional to the angles 64, etc. The 
minimum time path uses the portions of the 
second trajectories which are in the second 
and fourth quadrants. 


Fig. 6. Computer for maximum effort control of an undamped element (r= system input; c = system 
output; clipped values are represented by r and c). 
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Fig. 8. Step response with gain of 50. 
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Fig. 7. Effect of amplifier gain (K) on system response 
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Fig. 9. Effect of amplifier gain on system response: (a) gain of 5. (b) positive feedback around amplifier 
acts to increase gain to more than 1,000. 
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Fig. 10, System response to a load disturbance: 
(a) phase plane; 
(b) time response. 
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Fig, 11. Response of system containing a damped oscillatory element: (a) error derivative gain same 
as in control of undamped element; (b) error derivative gain is 0.4 of (a). 
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IDENTIFICATION AND COMMAND PROBLEMS 
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Abstract 


In order to satisfy stringent performance re- 
quirements in a dynamic process, a computer is in- 
corporated as a central element in the feedback 
loop, The computer performs the dual task of iden- 
tifying or measuring the process'dynamics, and 
thence generating an appropriate command or actu- 
ating signal so as to satisfy the overall specifi- 
cations, The family of singularity functions 
(steps, ramps, confluent parabolas) is used as the 
command signal. The process' dynamics are monitor- 
ed and identified by the computer without recourse 
to interrupting test signals such as periodic im- 
pulses or white noise. The stored energy term in- 
herent in many measurement problem in continuous 
processes is accounted for in a novel manner, 


I. Introduction 


The term “adaptive” control system has ap- 
peared only recently in the literature on feedback 
control systems, and as such, is still subject to 
various interpretations by different authors. The 
primary need for adaptive systems arises from the 
difficulties encountered in the design of control 
systems for processes whose dynamic parameters 
vary, often in an unpredictable manner. The con- 
ventional feedback system often employs a large 
loop gain to swamp out the dependence of the sys- 
tem transmission on the varying parameters; cer- 
tain model configurations have also been utilized 
in an attempt to nullify the effect of the varying 
parameters on the system performance. The design 
objective would then be to reduce the sensitivity 
of transmission with respect to some critical pa- 
rameter over the expected frequency range of the 
input signal. 


The adaptive approach would aim to maintain 
@ prescribed sensitivity or performance criterion 
in the face of process changes by appropriately 
varying the compensating networks, or in effect, 
the actuating signal to the process. The adaptive 
viewpoint would be especially suited to the design 
of controllers for processes whose dynamics are 
not completely known in advance. 


The following definition of an adaptive sys- 
tem has been suggested to the authors by J.G. 
Truxals a feedback control system is adaptive if 
the sensitivity with respect to a variable x is 
zero over an interval in x of non-zero magnitude. 


It is obvious that any realizable physical 
means used in reducing the system sensitivity can- 
not be made to react instantaneously to changes in 
the control process dynamics. The ideal expressed 


in the above definition is, therefore, only approx- 
1 


imately realizable. The use of modern computer 
circuits, both analog and digital, can make this 
approximation quite good. 


The nullification of system sensitivity with 
respect to any changes in the process dynamics 
calls for: 


(1) The identification of the process, and 


(2) The modification of the signal command- 
ing the process such that the desired system per- 
formance is achieved, 


The adaptive problem therefore logically splits 
into two halves - that of identification and 
command. A computer which performs this two-fold 
task is incorporated as a central element of the 
overall control system. The specific design of 
the computing circuits is based on the equations 
developed in Sections II and III of this paper. 


II. Tr Identification Problem 


This problem is trea at length in the lit- 
erature by several RED ferences i tha 6 
There is, of course, a common denominator for all 
attempts at formulating a mathematical model of 
the process! dynamics. Some properties of the ex- 
citation, and response signals must be combined 
together in some fashion to yield approximate nu- 
merical information regarding the process! dynam- 
ics. For a linear, time-invariant system the 
convolution integral 


t 
e(t) = 4 a(t) a(t-t)dt (1) 


must be solved to obtain g(t), the process! im- 
pulse response if a(t), the excitation, and c(t), 
the response, are known. 


Of course, the convolution or superposition 
integral is valid only for linear systems. How- 
ever, if the interval of integration, T, is chosen 
small enough such that the process! dynamics do 
not vary appreciably over this interval, then the 
convolution integral may be extended to non-linear 
systems. It should be emphasized that the valid- 
ity for such an assumption must be founded an 
some 4 priori information regarding the process! 
variations which whould set an upper limit on T. 
The lower limit of the interval must be set by 
the correlation time of the noise imbedded in the 
sys tem. 


For the system under consideration, the com- 
puter monitors the signals c(t) and a(t) and to some 
approximation solves the convolution integral for 
the process! unit step and/or impulse response ev- 
ery T seconds. The computer will then express the 
computed impulse response g,(t) (or step response) 
as a set of specific numerical values, each of which 
represents the solution of an equation by the com- 
puter. The accuracy of the approximation is com- 
mensurate with the type and size of the computer. 


Fig. 1 represents diagramatically, an em- 
bodiment of our approach. The actuating signal 
a(t) is generated by the computer which also iden- 
tifies the process. The problem of determining an 
appropriate command signal will be deferred until 
Section III. 


If the unit step response; u(t) of the con- 
trolled process is used in lieu of the unit impulse 
response, then the convolution integral (1) reads 


t 
c(t) = JS a(t) u(t-r)dt 
-00 


(2) 


or 


= 
c(t) = f at(r) u(teroats /ar(e) u(t-pat 
= 0 ° 


(3) 
= 1,(t)i+ 1,(t) 


, 


° 

The integral T,( t) = /f a'(t) u(t-t) embodies the 

-00 
stored energy in the output at time t due to past 
inputs before t = 0, It is this term which has 
been particularly troublesome in the measurement 
problem in other proposed adaptive systems. The 
problem of accounting for the stored energy can be 
resolved in the following fashion. If Ij(t) is ex- 
panded in a Taylor series about the origin (t=07) 
one obtains 


13(0)+? 


Ty(t) = 1,(0) + 1,(0)t+ y— + eee CM) 


where 


1,(0) = y; a (fT) u(-t)dT = se) _= c(0) 
-00 t=0 


' ele ’ Woes 
11(0) = / a(r)u ener oI, eo) 8) 
=- 0 = 


o 2 
1"(0) = v a’ (tu"(-t)at = a “ c"(07) 


t=0 


Hence 


on 


ICEL 


T,(t) = e(07) + te' (07) + 
(6) 


oO 
é ; 1 o£(07) 
al 
iso 


The operation dictated by Eq. (6) involves 
the sum of an infinite Taylor series, In practice, 
only a few terms need be taken since the series can 
be made to converge rapidly in the interval 04t<T 
by a judicious choice of T. Henceforth, n will be 
used as the upper limit on the summation index. 
Eq. (3) becomes 


7 tet 0) 
c(t) ->_ te (0) + I,(t) 


iso 


(7) 


The analytic evaluation of Io(t) may be simplified 
if the command signal a(t) is synthesized from el- 
ementary units, say the family of singularity func- 
tions, The following forms for a(t) will be con- 
sidered: 


(1) A set of impulses of varying areas spaced 
T seconds apart. 


(2) Successive step-functions, realized by 
passing a string of pulses through a 
zero-order holding device. a(t) is then 


a "staircase" function. 


A piecewise-linear tim function obtained 
by generating ramp functions every T 
seconds. 


(3) 


(4) 
(5) 
(a) 


"Staircase" Command Signal 


A series of confluent parabolas. 
A combination of such singularity functions. 


For the case at hand, let a(t) be the stair- 
case function shown in Fig. 2a. Then a'(t) is a 
string of impulses occurring at t = 0, T, 2T...,etc. 
as shown in Fig. 2b. In the interval O t T, 
T,( t) can now be readily evaluated to obtain 


t 
To(t) = J (agra_, Kt )u( t-t)dt = bagu(t), o<ter 
o 


(9) 
where 
ba, = ( a-a_,) (10) 


u(t), is the process' unit step response in the in- 
terval 0<t<T. If we let t = T” in Eqs. (6) and 
(9), Eq. (7) becomes 
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n 


eves 
c(T) = See) + bay u(T), (11) 
iso 
From which 
n 
435. 
(3 Te (o 
u(T), = = (12) 


u(T), is interpreted as the response of the pro- 
cess to a unit step applied T seconds earlier. 
Tr subscript 1 implies that the computation is 
performed in the first measurement interval. 


Similarly, 


(13) 


c(kT) - 


Thus Eq. (13) identifies the process step response 
at the k'th measuring period in terms of the value 
of the output at kT™ 


the values the output and 
its derivatives at the preceding (k-1)? | sampling 


instant, and the values of the command signal in 
the two preceding sampling intervals. 


& computer will now be called upon to carry 
out the dictates of Eq. (13) and yield the identi- 
fying function u(T),. The camputer selected or 
designed must carry out the computation in a time 
duration much lessthan the sampling interval T. 


b) Piecewise-Linear Command Signal 


let the command signal be the piecewise- 
linear curve of Fig. 3a; ™ is the slope of the 
straight line segment for kT<t<(k+1)T. Fig. 3b 
illustrates the derivative a'(t). By an analysis 
similar to that of Section (a), it is clear that 


a oe ee t 
c(t) = Pee + mM x u(t-t)dt O4t<T (1h) 


iso 


where 


t 


if ; -1 ) 
<ul t-T)dT = i utT)dt = u (t), (15) 


is the response of the process to a unit ramp in- 
put for 0 <t<T. The subscript has the same sig- 
nificance as that for the unit step response con- 
sidered previously. In the k'th interval, 
(k-1)T<t<2kT 


; > the! [(x-1) 17] t 
t) = 
c( & Tee 2 paren (pee 
(16) 
where 
t= t - (k-1)T (17) 
and 
t t 
w(t) = Sf ulttat = fu(rat (18) 
(k-1)T ° 


is the process! unit ramp response in the k'th in- 
terval. Solving Eq. (16) for the ramp response at 
t= kT, (or t = T) one obtains the identifying 
function 


tet [ie-ayr | 


c(kT) - —_ 


izo 


yh 


(c) Confluent Parabolas as‘Command Signals 


w(t), = (19) 


Let a(t) consist of a series of confluent 
Jarabolas as shown in Fig. where 


a(t) = a, + Sma E t(ke1)a)*, for (kel) retext 


(20) 
and 
\ 5k 5a r oe 
5 te(k-1)T 5 Shapes 
u “(t) = SJ w(t)aT= f at fu(x)dx (22) 
o ° ° 


at t= kT, th process! parabolic response can be 
shown to be 


Mtoe! [(Ke2) 07] 
pees 


i=o0 23 
my (23) 


e(kT ) - 


u?( T)y hed 


(a) Combination of Steps and Ramps 
as Command Signa s 


The identification problem is somewhat com- 
plicated when two singularity functions are syn- 
thesized as the command signal. However, as will 
be shown in Section III, such a combination per- 
mits an additional degree of freedom in satisfying 
the system specifications. Let the command sigml 
consist of steps and ramps as shown in Fig, $a. 
The derivative a'(t) shown in Mg, 5b then consists 
of impulses and steps. 


In the interval, (k-1)T <t<kT, 
at(t) = [ay 37( aot, MIS [e-(k-2) 1] +m) (2h) 


and the output during this interval a t-(k-1)t] 
is 


Reece} + 
e(t) = —=, -—* babies a'(t) u(t-T)dt 
iso 


Bidet [na] 
a es 


iso 


(25) 


2 [axe z (29h, 97) | t) +m u(t) 


In anticipation of the specifications to be set 
dom in Section III, the derivative of the output 
is also determined; for convenience, let the de- 
rivative be designated by b(t), i.e., b(t) = dc/dt. 
Then 


n ,i.4)7, 4)07 
coho 


iso 


+ [aot 27) Blt) + My Ct), 


(26) 
At t = kT’, Eqs. (25) and (26) become 
Bate! [te-1)27| 
c(kT ) = “= 22 6 Peer 
iso 
(27a) 


. [a,-1°¢ a, -9°% 27) | Tem 87 (Ty 
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mgte! [(-1)t7] 


b(kT™) = ie _ 


i=o 
(27b) 


“ fear %a*ee2™] e(T),+m,_su(T), 


where 


e(T), = response to a unit impulse applied 
at t = (k-1)T and evaluated at t = kT 
u(T), = response to a unit step 


a Ty = response to a unit ramp 


The identifying quantities, g( T)ie9 UCT) ks and 
u7 (7) are given in Eq. (27) by two sinltaneous 
equations. However, if g(T),, u(T),, and u (T) 
are considered as discrete variables, then, of 
course, the two equations in three unknowns can- 
not yield unique solutions. This dilemma may be 
resolved by recalling that Eqs. (27) were ob- 
tained fran two integro-differential equations 
which were evaluated at discrete intervals in 
time. Furthermore, u~-(t) is recognized as the 
integral of u(t) which, in turn, is the integral 
of g(t). The two simultaneous equations can be 
Simlated by analog techniques to yield u(t), etc. 
on a continuous basis. Readouts taken_every kT 
seconds will yield g(T),, u(T), and u(t)... 


Consider Eqs. (25) and (26) and define 


GT cor * Byer e-2*%-27)] 
(28) 
obo [(xeape"] 
2 eee 


iso 


Tyu1 t) i 


and then 


m etot[(eer)a] 


Ther(t) = >) a 


iso 


Substituting the definitions of Eqs. (28) into 
Eqs. (25) and (26), we obtain 


et) = Teag(t) = Ty yult) +m) wo Kt) = a(t) 


(29) 
w(t) - Tat) = Tet) + ms w(t) = «'(t) 


Eqs. (28) readily lend themselves to analog sim- 
lation and hence a continuous solution for u(t), 
etc. can be obtained. The output c(t) and its de- 
rivative are continuously monitored; inspection 
of Eqs. (28) reveals that J,.1 is known in terms 
of the past input, while 7 162) can be generated 
with a knowledge of c¢(t) end its derivatives at 

t = (k-1)T (or t = 0). 


The operation of this analog system will be 
continuous except for readouts taken at every 
t = kT seconds which will then_yield the required 
values of u(T),, g(T))s and u™ (T)y- Eqs. (29) 
can combined +h yield 


Q ’ 
“Ty-1 Bem, 4(t) - my S u(t)at = G3" (+) 
(30) 


& possible scheme for simulating this equation in 
block diagram form is show in Fig. 6. 


HII. The Command Problem 


Onee the computer has solved the identifica- 
tion problem, then it will be called upon to gen- 
erate an appropriate cammand signal to drive the 
process. Since it has been decided to use the 
family of singularity functions as the form for 
the command signal, then on the basis of the 
specifications, the computer is to decide, and 
generate, the required steps, ramps, etc. after 
each sampling interval. 


Let the desired output of the controlled pro- 
cess be y(t) where cq(t) may be some linear or 
nonlinear function of the input r(t). This de- 
sired output, cg(t), may be generated by applying 
the input r(t) to an appropriate model represent- 
ing the desired operation. This desired output 
can then be monitored continuously or periodically, 
and can be operated upon in any desired fashion. 


Various control strategies can be worked out. 
We shall limit our considerations at present to 
two sets of specifications. These are 


(a) Let the output c(t) approximately follow 
the desired output c4( t), at the sampling instants, 


e(kt) = ¢,[(k-1)T] (31) 


(b) In this instance, the computer is re- 
quired to match the output signal and its slope 
to the desired output and slope at the sampling 
instants with a unit time delay; i.e., 

e(kt) = ¢,[{k-1)T J 

(32) 


e'(kt) = eg [[k-1)T J 


A staircase command signal is generated by 
the computer to satisfy the specifications of 
Eq. (31), while a combination of steps and ramps 
are required for Eqs. (32). Of course, the speci- 
fications of Eqs. (32) impose a greater degree of 
complexity on the computer than those of Eq. (31). 


(a) Implementation of Eq. (31) with 


a Staircase Command Signal 
Let the command signal be the staircase 


function of Fig. 2. Eqs. (11) and (12) are re- 
written here for immediate reference. 


nese, a 
et) = ) TO. na, w(2), 
iso 
n i) es 
cer) = Bet) 
izo 
Aa, 


(11) 


u(T), = (12) 


If the strategy of Eq. (31) is to be satis- 
fied, then c(2T) = cg(T); substitution of Eq. (31) 
into Bq. (11) yields 


n 
eae 
e3(T) = (2) = etary u() a amG3) 


izo0 


Eq. (32) is to be solved for Aaj, the height of the 
step to be applied at t = T. But u(T)o is the re- 
sponse of the process at t = 2T to a unit step ap- 
plied at t = T, and is an unknown in Eq. (32). 

This dilemma can be resolved by assuming that u(T), 
is equal to u(T);, the previously measured step 
response. Such an assumption is valid provided 
that the process! dynamics do not vary appreciably 
over one sampling interval. Hence let 


Combining Eqs. (3h), (33) and (12) gives the 
required height of the step command at t = T or 


ba, fae ee lo on ha (35) 


The general term is 
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n_ pot (kr"] 
CET) pee son Sta 
i=o0 
da, = IN 36) 
“* y heel ooh [(k-1)T J et 
e(kt") = )° —— 
izo 


where n = number of terms in the Taylor expansion, 
ba,.} is the height of the step that was applied 
at t = (k-1)T and Sa, is the height of the step 
demanded at t = kT. The computer is to solve Eq. 
(36) at each t = kT - O for da, and thence to gen- 
erate ba, to command the procegs. 


(b) Implementation of Eq. (31) with 
Piecewise Linear Command Signal 


For reasons set down in (a) it is assumed that 
-1 reeds 


Combining Eqs. (31), (16), (19) and (37) in 
a fashion similar to that of Sectio II a, yields 
mM,, the required slope of the ramp command signal 
in the interval kT <t< (k+l)? 


iso 
= 38 
me Petter] Se 
e(kT ) - > Sap eee 


(c) Confluaat Parabola Command Signal 
for Eq. (31) 


The recurrence equation obtained by following 
the procedure outlined previously to satisfy the 
strategy of Eq. (31) is therefore, 


c,(kT) - So eltur) 
d 


izo 


Me eer] 
c(kT ) a SPE fps 


iz=o 


(d) Implementation of the Control Strategy of 
(Eq. 32) by Using Combinations of Steps and Ramps 
as a Command Signal 


The specifications of Eq. (32) require an 
additional degree of freedom in the command signal. 
These can be met by le tting the command consist 
of a sum of any two singularity functions, as for 
example the combination of staircase and piecewise- 
linear segments shown in Fig. 5 and analysed in 


(39) 
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Section I d. At this point it is assumed that 
the identification problem has been solved so 
that g7 (T)ys u(T),, and u-(T) are knowm. The 
computer must now i ternine the slope of the ramp 
my, and the height of the step a, required at 

t = kT to satisfy the specifications. Combining 
Eq. (32) with (27) gives 


n 
q eu, 
e[(k+1) 17] = oz Fer") + 
iso 
[aml can Meer] MD eg n%%e UC Mga™ Og6kD) 
(40) 


n 
unre 
b[(k+1)T7] = a pp (ut) + 
iso 
Lag 9g MT] CCM + Me Miya & BylKT) 


If it is assumed that 


UT 4g * Ty 


eM... 2 eT; (2) 


TD # OD 


then Eqs. (0) can be solved for a, and Tye 
Let us define 


Tl = 2 ee 


f) * i i 
1 ee (42) 


i=o 


Pres (8p st 
Furthermore, we define 
e(kn) - GC) + Py wl, = Fy 
(43) 
balk) - TCT) +Pyg BM, Ay 


so that Eqs. (0) take the form 


wT), unt Me} [% 


tae 


- (4h) 


te 


whose solution is 
ay u(T), -u}( T), Rx 
1 
ae (45) 
ma, -e(T), u(t), k 


u(t), wn *( 2), 
A = u(n)é - en), wn), (46) 
g(T), u(T), 


4 computer must now be programmed to solve Eqs. 
(U5) for a, and my, and thence to generate these 
at t = kT as the command signal to the process, 


IV. Computer Circuitry for 
Instrumentation of Eq. (36) 


It was decided to satisfy the specifications 
of Eq. (31) through the use of the staircase func- 
tion discussed in Sections II(a) and III(a). An 
hybrid computer was designed to solve Eq. (36) for 
the case when the Taylor series is truncated so 
that only the first derivative is included. Then 
the equation takes the form 


e (kT) - (kT) - Tc (kT) 


Fi haere eh ie A PE 
een) -e[ena-t Gen 


eek 


The circuitry described here to instrument 
Eq. (47) was designed by the late Professor M.V. 
Joyce. The block diagram for the computer is 
shown in Fig. 7 and the circuitry for each of the 
individual blocks is shown in the succeeding dia- 
grams. The H block represents a holding circuit, 
the T and 6 blocks are delay circuits; the -1 
block is a simple sign-changer, the ->. is an 
operation amplifier used as a summer and the = and 
x are dividers and multipliers respectively. The 
signals a,b,c,d represent pulse trains to read in 
and read out from the various hold and delay cir- 
cuits. The hold circuit shown in Fig. 8 is pulsed 
by the readout pulse b every T = 100 milliseconis. 
The time delay circuit consists of two hold cir- 
cuits in cascade; the delay depends on the time 
separation between the read in and read out pulses. 
The pulse train is shown in Fig. 1l(a), the pulse 
generator is shown schematically in Fig. 11(b). 


127 


The division operation is carried out implicity 
as shown in Fig. 10. 


To complete the picture, the actual input 
r(t) would drive a model whose output would be 
cg(t). The model would embody the desired system 
characteristics, and may be built into the com- 
puter itself. 


Experimental work has been temporarily 
stopped due to the sudden death of Professor M.V. 
Joyce, but it is hoped that some experimental 
data would be available in the near future. 


VY. Conclusions 


Ideally, the adaptive system which has been 
described in this paper, will satisfy the per- 
formance specifications despite unpredictable 
variations in the process! dynamics. In effect, 
the process is forced to behave in a desired 
fashion through the control exerted by the com- 
mand signal. To effect this arbitrary control, 
it has been necessary to use computing circuits 
whose complexity increases with the stringency 
of the requirements. If the adaptive approach 
is to be utilized, then there is a threshold level 
of computer facilities and correspondingly a 
threshold level of expense. 


Obviously, one would not resort to the adap- 
tive viewpoint to control a relatively simple 
process, as say a two=phase motor. The improve- 
ment in system performance is purchased at a dear 
price, which must be commensurate with the pro- 
cess to be controlled. Thus, there is a certain 
threshold boundary for the complexity of the 
controlled process and stringency of the perform- 
ance specifications beneath which computer-controlled 
adaptive systems will not be feasible. 
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Fig. 1. Computer controlled adaptive system. 
Fig. 3b. Derivative of a(t) yielding a staircase function. 
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Fig. 2b. Derivative of the staircase function—a train 
of impulses. 
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Fig. 5. Actuating signal a(t) and its derivative. 
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Fig. 3a. Piecewise linear form for a(t). 
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Fig. 6. Analog simulation of Eq. (30); the computer feeds potentiometers controlling my_j, and 0,_1. 


: iE 
+Tc'l( k— )T] 


Multiply 
OK= Ok-| 


AQ 
x eZ k 
Divide fer 
AG, 


Fig. 7. Block diagram for computer instrumentation of Eq. (47). 
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Fig. 9. Delay circuit. 
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Fig. 10. Divider. Fig. lla. Read-in and read-out pulse train for T = 100 
msec. 
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Summary 


The powerful Laplace transform method for 
transient analysis by the partial fraction expan- 
sion technique has become quite popular in the 
fields of circuit and servo design. The theory 
of residues is usually used to find the coef- 
ficients of these fractions. The process is quite 
simple until second and higher order poles are 
included in the denominator. Previously, this 
has required a return to the calculus to find the 
additional coefficients required. 


This paper discloses a simple technique for find- 
ing these additional coefficients by algebraic 
processes. As a result both manual and mach- 
ine computation can be performed more easily. 
The technique is described and its mathematical 
basis is rigorously proven. 


I Introduction 


This paper describes a simplified technique for 
the evaluation of the coefficients of partial 
fraction expansions, The method is based on the 
following relationships. 


Rule:: For a normalized ratio of polynomials: 
A. If the denominator is one degree higher 
than the numerator, the sum of the resi- 
dues is one. 
B. If the denominator is two or more 


degrees higher than the numerator, the 
sum of the residues is zero. 


The proof for these rulesis given inthe appendix. 


Several additional rules are derived from these 
to permit algebraic evaluation of partial fraction 
coefficients in cases for which the degree of the 
numerator is equal or higher than that of the 
denominator. 


The application of these rules provides a tech- 
nique for finding one residue as a simple 
function of the others. By this means it is pos- 
sible to find all of the coefficients of a partial 
fraction expansion by algebra even when higher 
order poles are involved. This technique 
reduces the effort of computation considerably 
whether the coefficients are being found direct- 
ly, graphically with computational aids such as 
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the Spirule or Nomoto's log-s plane charts, or 
with computers, either digital or algebraic such 
as the ESIAC. Before exploring this technique 

it will be useful to define the terms residue and 
normalized ratio as they are used in this paper. 


Residue refers only to the coefficients of terms 
with first degree denominators in a partial 
fraction expansion. Constants, coefficients of 
positive powers of s, and coefficients of terms 
with higher degree denominators are referred 
to as coefficients only. 


Normalization refers to the process of obtain- 
ing a coefficient of one for the highest power 
term in the polynomials of the numerator and 
denominator. This can always, be accomplished 
by factoring out the ratio of the coefficients of 
the highest order terms before making the 
partial fraction expansion. This ratio is then 
used as a multiplier for all of the resulting co- 
efficients. 


It_ Applications of the Rule 


The usefulness of this relationship of the sum of 
the residues for practical partial fraction ex- 
pansions can be easily demonstrated by several 
examples. 


A. First Order Poles Only: 


FRYERS * G5) a+ Gy 


The residues A and B are found by the usual 
technique of multiplying by (s+b;) and setting 
$=—b;. 


(a-b,) 


5 (a—-b,) 


then since A+B+C=0O the remaining residue © 
becomes 


C =— (A+B) 


Usually A and B are in numeric form so that C 
can be easily found. If there are only two poles 
and no zeros the residues will be equal in mag- 
nitude and opposite in sign. If there is only one 
less zero than pole the sum of the normalized 
residues will be one. If the degree of the 
numerator is equal to or higher than that of the 
denominator algebraic methods for finding the 
coefficients are still possible. Some of the 
techniques which can be used are given in 
section III. 


B. One Second Order Pole: 


aR aT aT 


(stbJ+b,) (stb) 


A and Ccan be found as above. 


By our definition only B and C are residues. 
Since B+C=0O: 


Thus an answer is obtained quickly and simply 
by inspection instead of having to make a 
complicated differentiation. 


The evaluation of coefficients in the presence of 
one second order pole can be generalized. Our 
problem can be stated as follows: 


Given: 


1 &+<)) C R, £ oR, 
i i = ate 
tbo) O(s+b,) (stb) i stb, 2, s+b,) 
: . 
i= 1,2,e¢¢,p 
J= 1,2,°°°e,Nn 
p< (n+2) 


Find: C,R,, all Ry. 


The values of R, can be found as before and can 
be written as: 


_ (s+by) F (s+ai) 


0 
Roe ee eee 
* (6+b,)° N(s+b;) he 
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The value of C is given by: 


Since the sum of the residues must be equal to 
zero or one we find that 


Ra = 8 ip+iy(ntz2) 7 ER, 
where 


8 _ fl for p+i=nte 
(p+i)(nt+2) ~ )O for p+izn+e2 


One Third Order Pole: 


Ge 


From the equation: 


(s+a) A oe ak ra ra Oha gh teal 


(stb)etb,)  (stb)° 


We find as before: 


then since C+D=0 


0) 


to find B both sides of the equation are multiplied 
by (s+b)) to obtain a new equation with only a 
second order pole. The new polynomial ratio is 
expanded into a partial fraction and the terms of 
this expansion are equated to similar ones from. 
(s+b,) times the original expansion to give: 


sta iy A B F 
(s+b)° (s+b,) ~ (stb) 


Note: Fcould have been written 


p(s +b,) 


ban s+b, 


but it is simpler to evaluate and use if it is taken 
from the new equation as indicated. 


Both A and B are the same as in the above 
equation and F can be found easily: 


then since F+B=0 


D. One High Order Pole: 


The same technique can be extended to include 
all such functions with a single high order pole. 


The equation to be solved is: 


T (5 +.a,) a Cs ae Rx 
(s+b,)" 1 (s+b;) 1 (s+ ae x2 (s+ bx) 
i= 1,2,e0¢e,p 
j=1,2,e0ee,n 
p< (n+!) 
Defining 
(st+bx) 0 (s+ai) 
Rye = 


(+b.)" *"'(s+b,) 


The values of R,, can be determined from this 
equation and the C's can be found from: 


ne Tt (s+a)) 
"" I (s+b 

j (s i) “els 
Cy = Bimin-t)(9) — 2 Re 


8 - J! for mtn-t=p 
(m+n—8)(p) O for mtn-2#p 


for values of ¢ such that 


1<?<m- 
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E. Two Second Order Poles: 


More than one high order pole can be handled 
also: 


\ a A ie B ve Cc ve D 
G+oF G+ Gt)” Gt) ” G+) G +b) 


A and C are easily found. They are: 


Then multiplying both sides of the original 
equation by (s+b) gives: 


] Seat C(stb) | Dd(stb) 
Genyery © Ge) + 8+ Gey’ t Gen) 


The last two terms can be expanded by the same 
techniques to give four terms, the first two are: 


(b-b,) 
(s+ be) (+b,) 


The coefficient of one for the (stb,) term results 
because the numerator is one order less than 
the denominator. Therefore, the sum of the 
residues is one. There is only one first order 
pole term in the expansion so its coefficient is 
this residue of one. 


The last term expands into 


D(b-b,) 


(s+b,) ae 
This gives 
Waites (bb) (b-,) 
Grape” +8 Geay tba) * Gem) 28 


the coefficient of the second order term can be 
more easily evaluated directly. Calling this 
coefficient E gives 


fog) (s+b,)° 


The sum of the residues is zero so 


A+C+D/(b-»,) = 0 


Therefore 

A+C 

D = 

(b,-b,) 

But 
= 
(b,-b.) 

So 


D = — (a+C)E = —2E° 


And the last coefficient is found to be 
== 2) 


Thus all the coefficients have been found by 
algebra, no differentiation was needed. The 
resulting equation can be reduced to 


! ep cae ve Sy ee 
Cryery © | eRe Gee)” ree G8) 
Where 


(b.-b,) 


E= 


These operations can be extended to higher 
order poles as required. With the basic rule 
about the sum of the residues, applied with 
usual algebraic manipulations, it appears that 
all differentiation can be avoided. 


Ill Additional Prope rties of Residues 


A. For a normalized polynomial with the same 
order numerator and denominator 


s'+as' + eee +a, 


s +bs | + ee +b, 
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the sum of the residues is a—b, 


The proof can be obtained by observing that 
Pe 
a,—b, 
ator of one degree less than the denominator. 


The sum of the residues must be one. P-—I has 
the same residues as P and they must be (a,—b,). 


is a normalized polynomial with a numer- 


B. If the numerator and denominator of a poly- 


P are of the same order then the sum of the 


residues of P+ will be zero. By (A) 


=R(P) = (a,—b,) 


and 
zR(p) = (b,-a) 
then 
=R(P) + =R (b) 20 
C. If the numerator of a polynomial is one 


degree higher than the denominator 


ae ge +48" +a,8 + eee + G4, 


s" +bs”' +b,s” + ee +b, 


then the 


=R(P) = a,+b,—a,—b, 


This can be shown in a manner similar to A. 


D. For a polynomial in which the numerator is 
(n-1) larger than the denominator the first » co- 
efficients of the numerator and the first n co- 
efficients of the denominator are sufficient to 
determine the sum of the residues. 


Conclusion: 


A theorem concerning the sum of the residues of 
the partial fraction expansion of a ratio of poly- 
nomials has been presented. It has been 
applied to the practial determination of the 
residues of several often-encountered expres- 
sions. In addition, other relations have been 
given which may prove us eful in expansions of 
greater complexity. 


Appendix 


Theorem: For a normalized ratio of poly- 
nomials: 
A. If the denominator is one degree higher 


than the numerator, the sum of the resi- 
dues is one. 


If the denominator is two or more 
degrees higher than the numerator, the 
sum of the residues is zero. 


Proof: Let the polynomial ratio be written in the 


form: 


n—(r+l) 


s tas tment Ore 


s| +bs| + eee+b, 
Let s be written in the form: 


$= Re!? 
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All of the poles are near the origin so that as R 
approaches infinity the value of the polynomial 
is approaching 


-jré 
Lim P —> : 
(Rea) R 
and the closed loop integral 
rand) Qj for r=l 
: j _|2wj for r= 
ae —f ERe o=| O for re2 


() 


therefore according to the residue theorem the 
sum of the residues will be 


hal for r=| 
ZR, = O for re2 


COHERENT OPTICAL DATA PROCESSING 


le Jee Cutrona, hes Nwleith andilped. eorcello 
The University of Michigan 
Ann Arbor, Michigan 


Summary 


Coherent optical systems, which utilize the 
wave nature of light and the consequent diffraction 
phenomena, may often be used to supplement or 
even replace complex electronic equipment. Such 
systems are particularly adapted to the perform- 
ance of certain linear mathematical operations, 
particularly those of an integral transform nature 
such as spectral analysis, convolution, auto- and 
cross-correlation, and matched filtering. The 
two-dimensional nature of optical systems, con- 
trasted with the inherent one-dimensional nature 
of an electronic channel, allows a great reduction 
in equipment complexity for certain classes of 
operations, 


This paper discusses the theory behind opti- 


cal channels and filters as outlined above; and also 


illustrates simple multi-channel optical systems 
which can carry out representative operations, 


Introductory Remarks 


The use of optical techniques for processing 
of information has been frequently proposed. Both 
coherent and non-coherent optical systems have 
been proposed and built. These optical systems 
possess tremendous potential as data processors 
as a consequence of (1) the large storage capacity 
of photographic materials (2) the two-dimensional 
nature of the storage medium and (3) the ease with 
which wide bandwidth signals can be recorded and 
made static on photographic materials. 


Despite these potentialities, optical systems 
have had limited fulfillment because of a number 
of severe problems, some of which have been 
overcome by the use of techniques to be described 
below. The advances in optical computing tech- 
niques which form the major content of this paper 
are the result of (1) the use of coherent optical 
techniques, and (2) the modification of the optical 
computer to have a multi-channel capability. 


The properties of coherent optical systems 
are not original with the authors, although it is 
believed that-some of these properties are used in 


novel fashion. The multi-channel use of an optical 
system also is not new. However, it is the belief 
of the authors that multi-channel operation prior 
to the work to be described herein has been con- 
siderably less versatile. The bulk of this paper, 
therefore will be devoted to the description of the 
configuration and to the properties of a multi- 
channel coherent optical signal processing system. 
Much of the versatility of the system will be seen 
to be a consequence of the fact that a coherent op- 
tical system is essentially a spectrum analyzer. 

A derivation of this result is given in Appendix I. 


An important capability of one optical config- 
uration to be described in this paper is the multi- 
channel evaluation of integrals of the form 


b(y, t) 
I(y, t) = f(x, y, t) g(x, y) dx (1) 


a(y, t) 


While important computations of this form are 
well known, it is perhaps useful to mention a few 
examples. This is done in Table I in which the 
specialized interpretations of the quantities in 
equation (1) are listed. 


The importance of the optical technique which 
evaluates the integrals of the form given as equa- 
tion (1) arises in part from the importance of 
problems such as those listed in Table I. How- 
ever, of equal importance is the ease with which 
such optical computations can be made. Some 
remarks to this effect are the following: 


(1) The recording of the functions f(x, y, t) and 
g(x, y) can be done readily. The photographing of 
intensity modulated cathode ray presentations or 
their equivalent is a direct means to convert to 
static form signal waveforms of very large band- 
widths. While care is required in the design of 
the camera and film transport mechanisms when 
multi-channel operation is required, the process 
is essentially straight forward. Moreover, the 
staticising of the signals means that signals with 
bandwidths of the order of 100 Mc/sec can be 
recorded. 

(2) A large number of independent channels 
can be evaluated simultaneously. The astigmatic 
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TABLE I 


Fourier Transform 


LaPlace Transform f(x) 


Auto-Correlation f(x) 


Cross-Correlation 


Antenna Pattern f(x) = antenna 
aperture 


distribution 


SOME SPECIAL CASES OF THE FORM OF EQUATION (1) 


sin 27xy 
cos amxy 


*Obviously integration over an infinite interval cannot be performed. 
However, in many practical cases either f(x, y, t) or g(x, y) will vanish outside 


some interval. 


optics described later keeps each channel separaie 
so that at least 20 channels per mm of film can be 
accomodated. 

(3) The coherent optical system behaves as a 
spectrum sorter. 


A band pass filter becomes an appropriately 
placed aperture, a stop band filter becomes an 
obstacle in the optics. This permits simple 
sorting of spectra and permits easy processing 
in the frequency domain. 


The exploitation of these characteristics is 
described in some detail in the sections which 
follow. In the sections which follow a single chan- 
nel optical configuration which performs a two- 
dimensional spectrum analysis is described. 


Following this discussion the modification of 
this configuration to produce a multi-channel one- 
dimensional spectrum analysis will be described. 
In a later section further characteristics of the 
multi-channel spectrum sorting capability of a 
coherent optical system will be developed, with 
emphasis placed on the use of optics to evaluate 
equation (2). 


Coherent Optical Systems 


In this section several coherent optical con- 
figurations and their characteristics will be de- 
scribed. The first configuration considered 
represents the state of the art before the work of 
the authors. In this configuration spherical optics 
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This replaces the infinite integral with appropriate finite limits. 


only are used. This configuration gives a single 
channel, two dimensional spectrum sorting capa- 
bility. 

In each of the configurations considered later 
inthis paper, astigmatic optics are used toachieve 
multi-channel operation, with one-dimensional 
spectrum sorting properties. 


Single Channel, Two Dimensional Spectrum 


Analyzer 


A coherent optical system without astigmatic 
elements such as that shown in Figure 1 produces 
a two-dimensional spectrum analysis in a con- 
figuration producing Franhaufer diffraction. The 
behavior of such a system can be described by 


E(q, B) = J | A(x, y) 
ae 


over aperture defining A(x, y) 


ee eee (2) 


In this expression, a and 8 are direction cosines 
of the ray direction which produces a signal am- 
plitude E(q@, B) in the focal plane Po» of lens Lo. 
A(x, y) specifies the transmission characteristics 
of a transparency in plane P, interposed between 
collimating lens L; and Lg. It may be real or 
complex. 


Frequency filtering can be carried out very 
Simply in plane Pg. Any obstacle at a point in Py 
defined by (a,8) is a stop band, any transparent 
region is a passband. Moreover, the use in Po 


of neutral density attenuating transparencies, with 
or without phase modifying characteristics, can 
be used to change either the magnitude or the 
phase of the spectral components in this plane. 


It is evident from equation (2) that 


(3) 


corresponds to the zero frequency or average 
value of A(x, y) averaged over the aperture in 
plane Pj. It is further evident from (2) that the 
two space frequencies increase as @ and 8 in- 
crease. The higher space frequencies (cycles per 
unit length) present in A(x, y) pass through plane 
Poy at greater values of a and 8. An aperture in 
plane Po, therefore sets the upper limits on the 
details which can be transmitted beyond plane Po. 


If Pg is the image plane for P,, the image in 
this plane can be modified by processing in plane 
Pg. This modification is the result of the spectral 
components a, B which are allowed to impinge on 
plane Pg. Filtering in plane Po to select the fre- 
quency components allowed to pass to Pg can be 
carried out toprovideanumber of functions. Prior 
work by O'Neill (Refs. 4,6) has shown how a cen- 


tral obstacle at 
a=B=0 


removes the average level and increases the con- 
trast of a photograph. He has also shown that the 
use of appropriate passbands in Py can be used to 
selectively emphasize signals in P}. Specifically 
shape selection and noise reduction were demon- 
strated. 


The Use of Astigmatic Optics To Achieve A 
Multi-channel Spectrum Analyzer 


The work performed by the authors has con- 
cerned itself with a modification of the configur- 
ation of Figure 1 to that shown in Figure 2. This 
configuration differs from that of Figure 1 in that 
two cylindrical lenses Ly and L5 have been added. 


The effect of the cylindrical lens Ly is to pro- 
duce focusing of rays leaving plane P, froma line, 


y =.constant, toa corresponding line, y' = constant, 


in plane Pg. Similarly light passing through a 

line, y' = constant, in Pg arrives at a correspond- 
ing line, y" = constant, in plane P3. Along such 
lines however, there will be a spectral decompo- 


sition of the structure. Specifically along a line 


y' = constant 


in plane Py will be found a spectral analysis of 
the information along the corresponding line 


y = constant 


in plane P,, Similarly along a line 


W 


y = constant 
in plane Px, will be found a spectral decomposition 
of the light along a line 


y' = constant 


in plane P,. The configuration of Figure 2, there- 
fore is a multi-channel spectrum analyzer. 


The multi-channel capability is easily demon- 
strated experimentally by placing an opaque ob- 
stacle with sides parallel to the x-axis in the P, 
plane. This will remove light from the corres- 
ponding intervals in Py and P3. Moving this ob- 
stacle in the Py plane keeping its edges parallel 
to the x-axis causes a corresponding movement 
in the Py and Pg planes. The edges of the cor- 
responding areas in planes Po and P, are sharp 
and correspond to the resolution of the optical 
system. 


The implication of this result is that the res- 
olution capability of the optical system determines 
the number of channels per unit length along the 
y direction. Successful operation with about 12 
channels per mm has been accomplished with ex- 
pectations that this packing can be increased to 
at least 20 channels per mm. Using 35 mm film, 
therefore, with 24 mm of the film width active, 
approximately 250 to 500 independent channels of 
information are available. The number of inde- 
pendent channels can be increased over this value 
in proportion to the film width used. 


The distribution of light amplitude along any 
line 
y' = constant 


in plane Py can be described by 


E(y', 6) = f Als, y) oll 27/X) x sin Les (4) 


where the integration with respect to xis carried 
out along the line 


y = constant 
in plane P,, which corresponds to the line 
y' = constant 


in plane Po. 
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In equation 4, A is the wavelength of the light 
source in Figure 2, while @ is the angle in a plane 


normal to Po, for 


y' = constant, 


between the optical axis of the system and the 
deviation of the light. Since P, is the focal plane 
of lens L, the correspondence between the point 
x' and the angle @ having the amplitude given by 
equation 4 is 


x= Eetan '@ 


where F is the focal length of lens Lo. 

The remarks which have been made concern- 
ing the relation of the light distribution in plane 
Po to that in plane P, are pertinent also to the 
relation of the light amplitude distribution in 
plane P, relative to those in plane Po - namely: 
each line in P3, 


W 


VW = 


constant 


has a light distribution along it whose amplitude 
is the spectral analysis of the light along the 
corresponding line 


y' = constant 


in plane Po. 

As contrasted to the remarks made with re- 
spect to Figure 1, the spectral decompositions 
made by the components shown in Figure 2 are 
one dimensional, As before, however, obstacles 
in plane Po (or P3) become stop bands, while 
transparent regions become pass bands. Thus, 
modification of the spectral content of each line 
of A(x, y) is possible in plane Po. 


The possibility of pass bands and stop bands 
has already been mentioned. However, itis 
possible to modify the spectral composition both 
in amplitude and in phase by locating neutral ab- 
sorption material and/or phase plates in plane 
Py. Again since each channel is independent, the 
operations performed in each channel can be made 
independent if desired. 


The versatility of the configuration of Figure 
2 (or slight modifications thereof) will be illus- 
trated by several examples - namely: 


(1) the use of the configuration as a multi- 
channel filter, 


(2) the use of a modified configuration to 
evaluate integrals of the form 


b(y, t) 
I(y, t) = f(x, y, t) g(x, y) dx 


a(y, t) 


(5) 


Spectrum Analysis Experiments. Several ex- 


periments illustrating the spectrum analysis 
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capability of coherent optical systems will be 
described in this section. 


Let the configuration of Figure 2 be consider- 
ed for the case that A(x, y) consists of a trans- 
parency as shown in Figure 3. 


This transparency consists of a number of 
strips of alternately opaque and transparent lines. 
The various strips have varying space frequencies 
(cycles per unit length). The transmissivity 
across each strip has the form given by Figure 
3b. It can be considered to be the superposition 
of an average or d-c, level plus a square wave. 


In the P, plane of Figure 2, a spectral an- 
alysis of A(x, y) by lines will be found. The re- 
sult of photographing the light amplitude distri- 
bution in plane Py with A(x, y) as shown in Figure 
3 is given in Figure 4. 


It will be noted that all channels have a re- 
corded signal at the center. This corresponds 
to the average level of illumination emerging 
from plane P,. The images in each strip show 
several lines on each side of the central image 
corresponding to the fundamental and to the har- 
monics of the signal in that strip. It will be 
noted that strips having lower space frequencies 
have spectral lines of closer spacing than do the 
strips with higher space frequencies. 


Examination of plane Pg in Figure2 reveals 
an image of plane Pie This is a consequence of 
performing a second spectral analysis on the 
light distribution in plane Po. A photograph of 
this image (for only one channel) is given as Fig- 
ure 5a. If an obstacle is placed in plane Poy to 
remove the central image, the contrast between 
the black and light regions disappears, as in 
Figure 5b. This interesting behavior can be 
understood by recalling that the eye and any photo- 
graphic recorder respond to light intensity, the 
square of the light amplitude. Before removal 
of the d-c component, the total light amplitude 
(bias plus square wave) was necessarily positive. 
Removal of the bias level however, causes the 


amplitude of the light reaching plane Pe. to have 
both positive and negative amplitudes. Since the 
eye and/or photographic recorders can only sense 
the square of this amplitude, both positive and 
negative amplitudes appear alike. This is the 
reason that the contrast in P, disappears when 
the d-c level is removed by filtering. Imper- 
fect Symmetry of the positive and negative half- 
cycles and loss of high-frequency components 
which accentuate the corners tend to cause the 
residual effects, in particular the dark lines be- 
tween the half cycles and the remaining slight 


contrast between positive and negative half-cycles. 


A second interesting experiment results from 
allowing the central image and the first set of 
side-bands to pass beyond plane P,5. In this case 
the image in plane Pg resembles the pattern in 
plane P, except that the amplitude variation is 
now sinusoidal in waveform rather than square. 
This is a consequence of the filtering which has 
selected the average level and the signal funda- 
mental. The result of performing this experi- 
ment is shown in Figure 6b. If the central image 
and the second pair of sidebands on each side of 
the central image are selected, the image in P 
consists of twice as many lines per unit length as 
are present in plane Py (Fig. 6c), but the am- 
plitudes are sinusoidal instead of square. This 
corresponds to selection of the average value 
and the second harmonic. Similar results can 
be obtained by selecting the central image and the 
3rd or higher pair of side-bands, verifying that 
these components arise from the spectral com- 
position of A(x, y) of Figure 3. 


A Versatile Multi-channel Optical Computer 
pier einen tebe Olin eee Se ee 


Let attention now be directed toward a con- 
figuration suitable for providing multi-channel 
outputs of the form of equation 5, The configur - 
ation of Figure 2 is modified to that of Figure 7. 


In this configuration lens Lg and cylindrical 
lens L, are added and ae is placed in the focal 
plane of Le.- A transparency [Bg + f(x, y)] is 
placed in plane Pj, while a transparency 
[By + g(x, y)] is placed in plane Pz, where Br and 
B are bias levels for these transparencies. 


In the absence of filtering in plane Po, an 
image of plane Pj would be formed in plane P3. 
This would illuminate the transparency in plane 
P3 so that the light amplitude emerging to the 
right of plane Ps will be the product 
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[B, + fx, y)] [B, + a 9] 
: (6) 


=B (6% ¥) aF AGS Ay) OS, W)e 


B +B f(x,y) +B 
Pg ned g 


Since the light amplitude in plane Py, is a spectral 
analysis of the signal across the corresponding 
line 
W 

v 
in plane Pg, the light amplitude distribution in 
plane P, consists of a line-by-line Fourier trans- 
form of expression 6. 


constant 


Igy xt!) = [(B, te i(x3-y"™)] 


j(27/X) x sin @ 


Gp ars e dx 


2 a5 tan @ (7) 


To convert equation (7) to the form of equation 
(5) it is necessary to set x''' = 0 (@ = 0) in equation 
(5) i.e., to accept the signals along x''' = 0 in 
Figure 7. Unfortunately the term BgBr being the 
product of two constants is itself a constant and 
puts energy into plane Py, at x'"! 0} This "seurouss 
ly reduces the contrast in the output. Some ad- 
vantages of filtering in the Py plane may now be 
made apparent. If an obstacle is placed in the Po 
plane at x' = 0, the d-c component, Be of the 
transparency in plane Py can be removed. This 
makes the light amplitude incident on plane P3 
proportional to f(x, y) without the bias level. Thus 
the first and third terms of the right hand side of 
expression 6 vanish. 


A question now arises concerning the possible 
error in evaluating equation (5) due to the second 
term of the right hand side of expression 6, This 
term B_f(x, y) can only be troublesome THe OS) 
has a d-c component. In this case a component 
due to this d-c level will appear at x'''= 0 in plane 
Pa: The error, due to this term however, can be 
removed from the system output by recording both 
f(x, y) and g(x, y) on a common carrier frequency. 
If the functions resulting from using f(x, y) and 
g(x, y) to modulate a common carrier frequency 
are designated by f'(x, y) and g'(x, y), then 
Bof"(x, y) will produce no output at x'!"= Oin Py 
and it can be shown that 


j(27/X)x sin 6 


[ {x.y g(x,y) e dx] 
6=0 
a [ [ #, ieee oil 2m/X)x sinds (8) 
8=0 


A proof of this equality is given in Appendix II. 


It is thus established that the configuration 
of Figure 7 can be used for the multi-channel 
evaluation of integrals of the form of equation 5, 
The above discussion has omitted many of the 
additional flexibilities which may be incorporated 
into coherent optical processors. Through neces- 
Sity, discussions of many of the attendant prob- 
lems have also been omitted. 


Concluding Remarks 
Ne eee Se 


Systems of the type discussed above offer the 
possibility of synthesis of transfer functions 
having independent phase and amplitude char- 
acteristics over a two dimensional region. It 
appears possible to synthesize otherwise complex 
comb filters in rather convenient form — that of 
a diffraction grating. The ease with which the 
second degree of freedom can be traded off for 
a multi-channel capability is appealing for certain 
applications, 


Among the list of disadvantages, one must 
include the noise-like effects of film grain, per- 
turbations in emulsion thickness, and the effect 
of spurious scattering of light at various points. 
Investigations which will dictate the ultimate 
limitations and practicability of optical computing 
or data handling channels are far from complete. 
However, the flexibility and inherent simplicity 
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of optical channels appear to assure this technique 
a promising role in forthcoming amenable com- 
puting and data handling problems. 
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Appendix I 


A coherent optical system has the inherent 
property that it will perform a spectral analysis 
of an inserted signal. This property is a result 
of the wave nature of the illumination. A one- 
dimensional argument is given below to serve as 
a physical derivation and demonstration of the 
spectrum analyzer feature. 


If one illuminates a diffraction grating using 
a coherent light source, one observes a diffrac- 
tion pattern which consists of a central image 
plus symmetrically positioned pairs of images 
which are off the optical axis. The angle @ be- 
tween the axis and the nth order spectral line is 
given by the well-known relation 


nda = d sin 6 
where is the wavelength of the incident illumina- 


tion and d is the grating constant. 


For the first order spectrum, X =dsin 6, If 
one now considers a grating having a smaller val- 
ue for d, the 1st order image appears at a larger 
value of the angle 6. Thus one can establish, fora 
given order spectrum, a correspondence between 
grating constant d and angle 0. 


Let us now consider a more general case, 
which we shall discuss in terms of the geometry 
of Figure A-1. 


For unit incident intensity at the plane of the 
transparency, the emergent light amplitude may 
be described by 


j(wt + o) 
E = Re [vaca el! 6)] 
where w = radian frequency of the light source 


A(x) = transmission of the transparency, 
a function of the independent 
variable x 


@ = some arbitrary phase angle. 


Consider the function 


VA(x) . 


For any angle 6, the amplitude in the P-plane is 


f(z) = 


E(t, 0) = Re [ r00 qilw(t-( sin @/c) + $) as 


0 
Re[I]. 
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The time average of the intensity at this angle @ 
is given by 


T T 
P(6) - = i Beat -= | {Re[1]} 7 at. 


0 ) 
But 


Reltls= 


x : 
i me) cos (ut ett a 2 + ’ dx 


0 


x : 
= | MAX (30) cos meee dx- cos (wt+@) 
0 


x ; 
- { 7 t(x) sin ees dx- sin (wt+¢). 
0) 


If f(x) is continuous in every finite interval 
+00 
and if # |f(x)| dx converges, then at every point x, 


-oo 
(-0o < x < ©) where f(x) has a right-and-left-band 
derivative, f(x) can be represented by its Fourier 
integral. The cosine and sine integrals for f(x) 
are given respectively by 


9) ee) 
f(x) =— | COS Q@x | f(x!) cos ax'dx' dx 
0) 
and 
) co co 
f(x) =— | sin ax i f(x!) sin ax'dx' da. 
1 
6) 0) 


In the above expression, the terms 


co 


oAh f(x!) cos ax' dx! 
0) 
and 
co 
= | f(b) Sintosche dsc! 
0 


are the Fourier cosine and sine coefficients cor- 
responding to any value of a, 0<w<o. 


If the function f(x!) is defined within the inter- 
val0 <x! <x,, and is zero outside this interval, 
the cosine coefficient becomes 


2 ee 
F' (a) == | fGa)scos oxida): 
c T 
0 


: in @ 
Letting @ = a" ,» one has 


ii] 


Bt. (a) 
c 


x 
As be 
2 | Me) are wx' sin 0 ke 
T c 


0 
= F (8). 


This is precisely the same form as was dem- 


onstrated above in the expression for E, Similarly 
ip 9 (@) = If (@) 
Ss Ss 
Therefore 
oe el shal, (8) 
i f(x!) aio eal Pg -2 fF (@) 
c 2 c 
0 
a wx' sin 6 1 
| f(x') sin dx" =—— Ht (@) 
Zien 2S: 
0 
1 : 
a +o) + . 
.-E 5 fF, cos (wt + ¢) F sin (wt + 0} 


Note that 8 and ES are not functions of t. 
2, 
me) Fo +F (0) 


It is therefore clear that a spectral decompo- 
sition of f(x) is displayed in the diffraction plane 
where a correspondence exists between spatial 
frequency content of f(x) and off-axis position for 
the diffracted images. 


Now consider independently the aperture am- 
plitude distribution function f(x), Assume that a 
Fourier transform of this amplitude function has 
been made. Since the function is viewed as a lin- 
ear superposition of its various frequency com- 
ponents, the diffraction pattern displays a number 
of lines with appropriate position and intensity 
values. Each line is a diffraction limited image 
of the initial point source of light, and its width 
is determined by the system aperture. Therefore 
the spatial frequency resolution capability of the 
spectrum analyzer is determined by its aperture, 
or the spatial extent of f(x), In the more general 
case, P(@) may be a continuous spectrum, but the 
resolution limit is still a diffraction limit. The 
diffraction pattern will display the d-c component 
of f(x) as the central image and corresponding to 
each angle @ there will appear a source image 
whose intensity is proportional to the sum of the 
square of the Fourier coefficients for the frequen- 
cy corresponding to that angle. 
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Appendix II 


It is the purpose of this appendix to derive 
equation (8) of the text — namely that 


(£60) g(x) 2 J(27/A)x sin 6, 


sl 


-cO 


6 =0 


: fe ae @ J(2m/r)x sin 9 ax 


eas @=0 
where f'(x) and g'(x) are related to f(x) and g(x) 
by virtue of having had their spectra translated 
by Wo radians per second, 


Specifically if F(w) and G(w) are the Fourier 
transforms of f(x) and g(x) while F' (w) and G' (w) 
are the transforms of f' (x) and g'(x), then 


F' (w) | = F(w-w,) LOT WeaO 11-2 

= F(wtw~) for oy <0 
Oo 4 
Im), = o) for Jw] <w. 
! = = 

G! (w) {= G(w W) for w>0 11-3 
= G(utw,) for w < 0 

G'(w) = 0 for |w| <u, é 


If the value of @ in equation II-1 is set equal 
to zero then it will be sufficient to show that 


(ee bid) (obs = le (x) ol (x) dari oll=4 


-cO -o 


By Parseval's Theorem, one can write 


fi g(x) dx = [Fe Gi-u) dine 441-5 
and 
[pee maar | F'(w) G' (-w) d+ 11-6 


It will be shown that the right hand side of 
equations II-5 and II-6 are equal. Then the left 
hand sides of these equations will also be equal 
and equation II-4 will be established, as will also 
equation II-1. 


It is convenient to divide the interval of inte- 
gration of the right hand side of II-6 into three 


intervals —namely from -. to Was from -w_ to By change of variable of integration the right 
Wo, and fromw,to+«, Since both F'(w) and hand integrals in II-7 can be written as 

G'(w) vanish for |w] < Wo only two of the integrals 
need be evaluated, If the appropriate forms for 


(ve) (6) 
134 G' (-w) dw = F(Z) G(-Z) dZ 
F'(w) and G'(w) from II-2 and II-3 are used in II-6 | (w) (-w) dw | (Z) G(-Z) 


the result is =00 — 900 
a oF a] F(Z) G(-Z) dz 
| Eoin) dys | F(utw,) G(-w -w,) du 6 


= ” F(Z) G(-Z) dZ. 


co 


+{ F(w-w_) G(-w+w_) dw. 11-7 een 
(e) Oo 


oO This is the desired result. 


The preceding work was supported by the U.S. Army and U.S. Air Force. 


A(x) = Transmission of Transparency 


Amplitude = A(x) cosw (* aes ao) 


Coherent 
Light 


Source 
= 


A-1 FRAUNHOFER DIFFRACTION GEOMETRY 
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E(a, B) 


FIG. 1 CONFIGURATION PRODUCING FRAUNHOFER 
DIFFRACTION IN TWO DIMENSIONS 


FIG. 2 MODIFICATION OF TWO-DIMENSIONAL CONFIG- 
URATION TO INTRODUCE MULTI-CHANNEL CAPABILITY 
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a) Square-wave diffraction grating. 


FIG. 4 DIFFRACTION PATTERN PRODUCED BY THE 
MULTI-CHANNEL DIFFRACTION GRATING 
b) Image of square-wave grating when filter transmits 
d-c and fundamental only. 


a) Square-wave diffraction grating. 


c) Image of square-wave grating when filter transmits 
d-c and 2nd harmonic only. 


FIG. 6 


b) Image of square-wave grating after bias removal. 


FIG. 5 
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POLE DETERMINATIONS WITH COMPLEX-—ZERO INPUTS 


John A. Brussolo 
Beckman Instruments, Inc., Berkeley Division 


and 


University of California 
Berkeley, California 


Summary. A method for the détermination 
of the characteristic pole locations in 
simple systems and components is dis- 
cussed. The techniques introduced are 
extended to include more complex sys- 
tems. The method consists of applying 

a signal to the system from a "complex- 
zero-generator" and then observing the 
system output response on an oscillo-— 
graph. The system pole locations are 
determined when the system output goes 
through a null, which occurs when the 
zeros generated by the "complex-zero- 
generator" cancel the system poles. 
Tests on experimental systems indicate 
that the pole locations can be determin— 
ed accurately and rapidly for a wide 
variety of systems. 


For testing purposes, a "complex 
zero-generator" was built using two 
Square-wave generators with a timed de-— 
lay between them. This generator gives 
@ signal which can contain complex zeros 
anywhere in the s-plane. This Signal is 
then applied to a number of systems con- 
taining several different relative pole 
orientations. The system outputs, as 
photographed on the oscillograph, are 
studied to develop rules and procedures 
to determine the pole locations. The 
rules are then applied to a number of 
"unknown" systems in order to determine 
their applicability and a study is made 
of the errors and limitations involved. 


The results indicate that the method 
described is readily applicable to many 
systems and that, in many instances, the 
pole locations are determined more accu— 
rately and more rapidly than cen be done 
through the use of a steady-state fre- 
quency analysis. 


Introduction 


A novel method of determining the 
characteristic pole locations in simple 
systems and components has been present- 
ed recently by George G. Lendaris and 
Otto J.M. Smith in a paper entitled 
"Complex—Zero Signal Generator for Rapid 
System Testing".~ A brief exposition of 
this work is followed by an extension of 
the techniques described to more complex 
systems. 


The method employed by Lendaris and 
Smith differs radically in its approach 
to the problem from the conventional pro— 


cedures of making a steady state frequen- 
cy analysis or a transient response anal- 
ysis. Use is made of a "complex—zero~ 
generator", (CZG). This signal is used 

as an input to the system, and the sys-— 
tem output observed as an oscillographic 
trace. When the zeros generated by the 
CZG are placed so as to cancel the poles 
of the system being tested, a part of 

the system output will go through a null. 
At this point, the characteristic pole 
locations are given by the known zero lo- 
cations determined by the CZG calibration. 


Complex-Zero-Generator 


It has been shown in the paper men— 
tioned previously that complex zeros can 
be generated by using a double-step time 
function as shown in Fig. 1. This func- 
tion has a pole at s = O and zeros where 


awe Os 


4 
If we denote the s-—plane locations 
of the roots of this input function by 
s = + jB we find that the function has 
an infinite column of zeros in the s- 
plane where: 


c= pak, 
p= 2 Az 0 
n = Opens Sos 


The s—plane locations of these 
zeros are shown in Fig. 2 along with the 
corresponding time function. We see 
that by varying the b/a ratio in sign 
and magnitude we can generate real or 
complex zeros in any part of the s—plane. 


A generator to provide double-steps 
was constructed and, in block diagram 
form, appears as shown in Fig. 3. The 
main elements consist of two square wave 
generators, one of which is controlled 
by the other. The slave SWG delivers a 
square wave delayed by a variable time f 
after the master SWG. The two signals 
are added and produce the output wave 
shown in Fig. 3. Since the system out—_ 
put is periodic, if the square wave per-— 
iod is made long in comparison to the 
time that it takes the system transient 
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to die out, the system output can be 
continuously displayed on an oscillo- 
graph screen. 


Pole Determinations for Simple Systems 


Lendaris and Smith describe the 
method of operation necessary to find 
the characteristic pole locations for 
simple systems consisting of one real 
pole, a complex pole—pair, or one real 
pole plus one complex pole-pair. 


Consider first a simple system con- 
sisting of a single complex pole-pair. 
The s—plane pole-locations for this type 
of system along with the single-step re- 
sponse are shown in Fig. 4. If we use 
the CZG to generate a pair of complex 
zeros as an input to the system, the sys- 
tem response will consist of the normal 
single-step response up to the time of 
the introduction of the second step. 
After the second step is applied the sys- 
tem response is composed of the sum of 
the single-step response and the re- 
sponse due to the second step. If, when 
the second step is introduced, the delay 
time T and the amplitude ratio b/a have 
been adjusted to give zeros exactly at 
the system pole locations, after the 
time T, the response will be deadbeat 
(i.e. a constant) since the poles have 
been removed from the response by can- 
cellation with zeros. This type of 
deadbeat response is shown in Fig. 5. 


It can be shown that, for a system 
consisting of a single complex pole-pair, 
the second step must occur in time at 
exactly the time of the peak of the first 
overshoot in the single-step response. 

A practical procedure would then involve 
using a dual-trace oscillograph which 
presents both the system response and 
the double-step input. The second step 
delay time T is adjusted until the 
second step occurs at the time of the 
first overshoot peak. Then the ampli- 
tude ratio b/a is adjusted to give a 
deadbeat response. The readings of the 
CZG dials then give the locations of the 
complex zeros which are the same as the 
system poles. 


For a system with a complex pole- 
pair plus a real pole, the procedure to 
be used consists of nulling. out first 
the complex pole-pair and then the real 
pole. With the complex pole-pair nulled 
out, the response observed is only that 
due to a single real pole and with the 
real pole nulled, the response is that 
due to the omplex pole-pair alone. These 
responses are shown in Fig. 6 along with 
the single-step response. 
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Pole Determinations for Complex Systems 


Extension of the methods discussed 
to more complex systems follows from the 
consideration that when one pole or com-— 
plex pole-pair is nulled out the re- 
sponse remaining has the characteristics 
of the remaining poles only. Thus, if 
the separate responses for the real poles 
or complex pole-—pairs in the system are 
different enough so that the eye can dis-— 
tinguish them, they can be nulled out 
separately, one-by-one. However, if the 
system poles are spaced closely together, 
the eye cannot distinguish as well the 
separate responses, and a different pro- 
cedure must be adopted. 


The approach used here was to rely 
on direct experimental observation of as 
many different systems as was practicable. 
By looking at the responses obtained in 
a variety of cases and analyzing these 
responses in several different manners, 
some general rules and procedures for in- 
vestigating complex systems have been 
formulated. 


Several systems were built and re— 
sponses photographed for inputs contain- 
ing different zero locations. The system 
which proved to be the most valuable con-— 
sisted of a representation on an elec= 
tronic analog computer. 


The systems used were restricted to 
those having two complex pole-pairs 
spaced relatively closely together. In 
addition, the systems tested were lightly 
damped, i.e. the ratio w/o for each pole 
pair was made high, approximately 10/1. 
The reason this was done was to obtain 
several cycles of oscillation in the re- 
sponse in order to help develop criteria 
for finding the poles. Fig. 7 shows the 
pole locations in the s-plane for the 
seven types of systems studied. 


The procedure followed was to set 
up each system individually and then, 
using the CZG to provide inputs to the 
system, to vary the second step time de- 
lay and amplitude ratio to give complex 
zeros located in various spots in the re-— 
gion of the poles. The response to each 
of these inputs was photographed and then 
the responses for each system were group— 
ed together and photographed again. These 
appear as Figures 8 through 14. The re- 
sponses are shown, placed in the s-plane. 
Each picture represents the response of 
the system obtained by using the CZG to 
place a zero at the picture location in 
the s-plane. The system pole locations 
can be seen in each figure as black cros- 
ses underneath a response photograph. The 


figures show only the upper half of the 
left—-half s-plane for economy. 


Direct examination of Figs. 8 - 14 
with the aid of a transient vector dia- 
gram analysis2 enables us to develop 
rules for finding the characteristic 
pole locations in systems of this type. 
Before stating the rules developed, the 
main results of the analysis of Figs. 

8 ~ 14 can be summarized as follows: 


1. We can tell that the system has 
at least two complex pole-pairs by ob- 
serving the first undershoot in the sin- 
gle-step response. The amplitude of the 
first undershoot is always greater than 
that which would be obtained with a 
single complex pole-pair. This is a 
consequence of the phases of the residues 
at the poles being about 180° out of 
phase. In general, one of the transient 
vectors is rotating faster than the 
other, and will catch up with and rein- 
force the slower one. 


Also, in the single-step response, 
if measurements are made of the times be- 
tween successive pairs of overshoot peaks 
it will be found that the frequency of 
the response will not be a constant but 
will vary for at least the first part of 
the response curve. 


2. When a zero is placed exactly on 
top of one pole, the system response is 
due entirely to the other pole. This 
could be expected since the zero cancels 
the pole on which it lies and leaves only 
the other pole in the system. 


3. We can always tell when the zero 
is outside the pole range and in which 
direction. As can be seen in Figs. 8-14, 
the responses obtained for a zero placed 
somewhat above the higher-—frequency pole 
and for a zero placed somewhat below the 
lower-—frequency pole have characteristics 
that set them apart from the responses 
obtained for a zero in between the poles. 
The response for a zero placed above the 
higher-—frequency pole has an apparent 
resonant frequency approximately that of 
the lower-frequency pole and vice-versa. 


4. We can always tell when the zero 
is inside the pole range. Many changes 
occur in the response for zeros placed 
in this region. It can be seen, by look- 
ing at Figs. 8 - 14, that the most char- 
acteristic responses are obtained for a 
zero placed, not only in between the 
poles, but on the jw-axis. Therefore 
this would be a logical place to start 


the t 
et esting procedure on an unknown sys— 
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5. We can find a point approximate-— 
ly halfway between the poles in terms of 
w. It can be shown that this particular 
point is a unique one and is primarily 
the factor which enables us to find the 
pole locations accurately. As the zero 
is moved down the jw-axis from above the 
higher pole, when the zero reaches the 
region of the mid-frequency point, the 
response shows the beginning of a "bump" 
between the first and second overshoots. 
This is evident in Pigs. 8 - 14 for all 
seven systems. 


6. We can sometimes find a point 
approximately halfway between the poles 
in terms of o; however, this point is not 
as well-defined as the one on the jw—axis. 


7. The lower-frequency pole is gen- 
erally much easier to find than the high- 
er-frequency pole, since the responses 
for zeros placed in the region of the lo- 
wer—frequency pole change rapidly for 
small changes in zero location. 


8. Larger changes in the system re- 
sponse are obtained for smaller changes 
in zero location when the zero is close 
to the jw-axis. 


Rules for Finding the Pole Locations 


Based on an analysis of Figs. 8 - 14 
three separate methods have been develop— 
ed to find the characteristic pole loca— 
tions for systems of this type. An ad- 
ditional method can be employed by prop- 
erly averaging the results of two of the 
basic methods. Only one method gives 
the exact coordinates of the poles; the 
others give an approximation to the pole 
locations. It was felt that the approxi- 
mate methods should be developed since 
they are easier to use and still give 
good results. 


The first step in any method is to 
ascertain that the system does consist 
of two complex pole-pairs. Quite often 
this information can be deduced from the 
single-step response by looking at the 
amplitude of the first undershoot or by 
the presence of beat notes in the oscil- 
lations. If neither of these criteria is 
present, the operator of the CZG would 
try to find a null assuming a single com- 
plex pole-pair. When this cannot be 
achieved, it would then be assumed that 
there are at least two complex pole- 
pairs. It should be noted that the ab-— 
sence of a single exponential envelope 
decay or the presence of beat notes can 
give valuable clues to the relative 
orientation of the poles and thus simpli- 
fy the task of finding their locations. 


Method I. (See Fig. 15.) 

1. Use a b/a ratio of 1.0 (i.e. 0) 
on the CZG and vary T from low values to 
high values. This places a zero on the 
jw-axis and brings it down the axis from 
high frequencies to low frequencies. 

For B (the zeroooordinate) above the 
higher pole, the response looks like 
that due to a single complex pole-—pair. 
As B is made smaller, eventually a point 
is reached where the response departs 
from that due to a single complex pole- 
pair. At this point the response shows 
a "bump" starting to form between the 
first and second overshoots. When this 
occurs the zero is approximately halfway 
between the poles in terms of w. The 
zero is stopped here and its location 
recorded from the CZG dial readings. 
Call the coordinates of this point: 


(O, wo). 


2. T from the CZG ( i.e. $8) is now 
kept constant and b/a is varied toward 
O from 1.0. Now the generated zero is 
moving to the left in the s-plane along 
a line of constant frequency approxi- 
mately halfway between the poles. As 
the zero is moved to the left, the re- 
sponse will begin to straighten out 
again to that of a single complex pole— 
pair. When this occurs, and where the 
decay rate is the same as it was for the 
response with zero placed above the high- 
er-frequency pole in step 1., the zero 
is approximately halfway between the 
poles in terms of o. The zero is stopped 
here and its location recorded from the 
CZG dial readings. The coordinates of 
this point we will call (o,9 wd. 


3. We now have the o and w approx-— 
imately halfway between the poles. We 
can proceed to find one of the poles 
exactly and since the lower—frequency 
pole is easier to find because of the 
rapid response changes for a zero in its 
vicinity, we choose to find this one. 

To accomplish this, we vary T on the CZG 
in the proper manner to move the zero 
down from its midpoint position in small 
steps. At each step the b/a ratio on the 
CZG is varied to sweep a range of the s- 
plane. When the response obtained is 
that due to a single complex pole-pair 
only, the zero is sitting exactly on top 
of the lower-—frequency pole. Call the co- 
ordinates of this point (o,, w,)- 


4. We have now found one pole and we 
can calculate the location of the higher- 
frequency pole, whose coordinates we will 
call (o,5 w.)- The higher-frequency pole 
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coordinates are given by: 
o 


D 20, 07 as tit 1 ew — 


Method II. 


The procedure used in this method is 
the same as that used in Method I. How-— 
ever, here the midpoint coordinates (0, 
w_) are ignored since they are only 
approximate and both the lower-—frequency 
pole and the higher-frequency pole are 
found separately. 


Method III. 


This is the most accurate of the 
three methods employed and corresponding-— 
ly takes more time and care to use. In 
this method, the midpoint between the 
poles is found as before but it is used 
as a reference point only, to place the 
zero in the vicinity of the poles. From 
here the zero is moved down or up and a- 
eross the s-—plane as in step 3 of Method 
I, and the response observed on the os— 
cillograph. As the zero location is 
moved and the response changes, the hor- 
izgontal gain control on the oscillograph 
is varied in order to allow comparison by 
eye of the times between the overshoot 
peaks. This is shown in Fig. 16. 


When the zero is anywhere in the s- 
plane except on top of one of the poles, 
the frequency of the output will be a 
combination of the two pole-frequencies. 
This means that the time between success— 
ive overshoot peaks will not be constant 
but will vary, either increasing or de- 
creasing for successive peaks. However, 
when one pole is cancelled by a zero, 
the response will contain only orm fre- 
quency and the time between successive 
overshoot peaks will be a constant. This 
is relatively easy to check on an oscil- 
lograph screen. Thus the procedure is 
to get the zero from the midway point to 
the vicinity of a pole where the response 
looks like that due to a single complex 
pole-pair. At this point the times be- 
tween successive peaks are measured on 
the oscillograph screen and the zero is 
moved slightly up and down and right and 
left until the measured times are equal. 
At this point the zero is exactly on top 
of the pole and the pole coordinates are 
determined from the CZG dial readings. 
This process is repeated for the other 
pole. 


Errors and Limitations 


There are several types of errors 
involved in the use of any of the me th— 
ods described. Perhaps the largest er- 


ror involved in all but Method III is 
the fact that finding a pole position de- 
pends on the ability of the eye to rec-— 
ognize a pure damped sinusoid. This can 
be extremely difficult under certain 
conditions, such as having the pole- 
pairs located very closely together as 
shown in Fig. 8. This is why Method III 
gives more accurate results than the 
other methods. It uses a procedure that 
allows one to detect differences very 
readily. Another large error which may 
occur when using the first two methods 
is in the determination of the o-coordi- 
nate. For certain systems the error in 
the o-coordinate can be as large as 100% 
unless Method III is used. 


To check the accuracy of the meth-— 
ods developed, pole determinations were 
made on thirty-five different systems 
with random pole-—pair spacing. The pro- 
cedure followed was to set up a system 
on an electronic analog computer where 
each complex pole-pair was generated in 
a separate section and then the sections 
were cascaded. All three of the methods 
were employed, in sequence, to determine 
the system pole locations. The exact 
pole locations were also determined for 
each section separately using the CZCG, 
since the method is extremely accurate 
for single complex pole-—pairs. 


The pole locations determined 
through the use of each of the three 
methods were compared with the true pole 
locations and the errors calculated. 
This was done for a rather small sample 
of thirty-five systems but the results 
show a good correlation. It should be 
noted that the types of systems tested 
included eleven different systems which 
had an w/o ratio of about 1.2 which 
would indicate that the methods described 
are valid for a wide range of the w/o 
ratio. This is true even though the en— 
pirical work used to derive the rules 
for locating poles was done for w/o 
ratios of about 10 tol. 


An examination of the errors invol- 
ved in the determination of the pole lo- 
cations for these systems shows that for 
Methods I and II, errors of up to 10% in 
the w-coordinate and 16% in the o-coor- 
dinate were obtained. 


However, errors were obtained as 
high as 50% in the pole-to-pole spacing 
in the w-direction and up to 200% in the 
pole-to-pole spacing in the o-—direction. 
The superiority of Method III is demon- 
strated by maximum errors of 2% and 5% in 
the w-coordinates and o-coordinates re-— 
spectively. In addition, the maximum er- 


rors obtained for Method III in the pole- 
to—pole spacings were 2% and 9% in the w- 
direction and o-direction respectively. 
Thus, it is apparent that if a person de- 
sired accuracies of 15%, for example, in 
the actual pole positions, he could use 
Method I; but if he desired the same per— 
centage of accuracy in the measurement of 
the pole-pair spacing he would need to 
use Method III. 


We should note, before leaving the 
subject of errors in these methods of 
pole locations, that in general, several 
cycles of oscillation should be available 
to observe in the response. The reason 
for this is that Method III depends on 
having at least three overshoot peaks and 
this method is the most accurate. This 
means that better results are obtainable 
with lightly-damped systems than with 
heavily-—damped systems. The errors ob-— 
tained however, include systems with rel- 
atively heavy damping and the maximum er- 
rors result from these heavily damped 
systems. Therefore, for lightly damped 
systems we would expect the range of er- 
rors to decrease and we could predict 
much better results. 


Conclusions 


The results of the analysis and ex-— 
perimentation carried out indicate that 
the methods outlined are sufficient to 
enable the determination of pole loca-— 
tions in systems more complex than have 
been originally described. The proce- 
dures developed have their limitations 
of course, although it will be found that 
they cover a large number of systems or 
networks that are generally encountered. 
Few systems have more than two dominant 
complex pole-pairs in addition to two or 
three real poles. 


It is felt that the techniques pre- 
sented here can be extended to include 
some of the less common complex systems. 
In addition, there is room for improve- 
ment in the procedure itself in regard 
to speed, simplicity, and accuracy of 
operation. A more rigorous approach 
through the development of the associated 
mathematics would be highly desirable. 


For the types of systems treated, 
this method of cancelling system poles 
with generated zeros offers relief from 
the tedious process of making a steady- 
state frequency analysis with or without 
a transient response analysis to obtain 
the system equations. In this respect 
it should be noted that, using the meth- 
ods described, the pole locations for 
systems having up to two complex pole- 
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pairs can be found in from five to ten 
minutes by a moderately experienced per- 
son. This is less than one-third of the 
time required to make a steady-state fre- 
quency analysis for a comparable system. 


The underlying simplicity of the 
pole-cancellation technique promises 
more general use of this method as fur- 
ther developments are made. 
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RANDOM NOISE WITH BIAS SIGNALS IN NONLINEAR DEVICES 


George S. Axelby 
Westinghouse Electric Corporation 


Summary 


A number of investigations have been made in 
recent years about the transmission of Gaussian 
noise through nonlinear devices. In many cases, 
simplification or approximations were needed to 
make analytical solutions possible, and only zero 
average Gaussian input signals were used when the 
results were applied to feedback control systems. 


This paper presents a different approach to 
the problem of noise transmission through non- 
linear single-valued elements. Basically, ampli- 
tudes removed by nonlinear saturation or deadzones 
are replaced by impulses in the amplitude distri- 
bution functions of the output signals, and the 
resulting first and second moments of the output 
distribution are computed to yield the average 
and rms value of the output signal. The solution 
may be found by graphical or mathematical integra- 
tion, a visual representation of the phenomenon 
is obtained, and input signals with any distribu- 
tions having non-zero average values may be con- 
sidered. 


It is shown that there is an equivalent 
transmission function or describing function for 
the average value of the noise, another for the 
rms value, and that one is a function of the other. 
Examples of the functions are given and the simp- 
ler functions with zero-average values are com- 
pared to the results obtained by other methods. 


Finally, the application of the noise describ- 
ing functions to feedback control systems is dis- 
cussed. Theoretical results are compared with 
those obtained from analog simulations. 


Introduction 
Investigations by M. Kac! A. J. F. stevert. 
D. Middleton,3 J. L. Lawson and G. E. Uhlenbgck,4 
R. C. Booton,> and K. Chuang and L. F. Kazda™ have 
provided a sound mathematical background for deter- 
mining the noise output of nonlinear devices sub- 
jected to Gaussian inputs. Most of the methods 
developed have been concerned with the determina- 
tion of probability distributions of saturated 
and rectified noise from which the output noise 
characteristics could be found. In general, these 
were primarily mathematical developments, and they 
were not particularly adaptable for analysis of 
control systems with nonlinear devices. 


However, in 1953, Booton developed a differ- 
ent approach to the transmission of noise through 
nonlinear devices, and he applied the results to 
control loops containing nonlinear elements. 


Booton proposed to obtain an equivalent gain 
function of a nonlinear device by comparing the 
output of the nonlinearity with the output of an 
equivalent gain function. The equivalent gain was 
chosen as the one which would yield the minimum 
rms difference between the two outputs. The 
method is summarized in Figure 1 for reference. 
This procedure gave reasonably good correlation 
between measured and expected rms outputs of non- 
linear elements, and it was shown how the equiva- 
lent gain, referred to as a describing function, 
could be used to predict the performance of a 
feedback control loop. However, in the process of 
calculating the rms output, the physical signifi- 
cance or meaning of the calculation was not appar- 
ent. Although physical visualization is not 
particularly important, or even helpful, in solv- 
ing many mathematical problems, it is often useful 
to engineers who must develop and translate mathe- 
matical concepts into physical reality. Many 
times, if a physical representation of a process 
is available, engineers can more efficiently pre- 
dict the performance of a device, perhaps find 
improved methods of calculation, and often obtain 
more insight about actual system operation through 
visionary processes. 


Output Amplitude Distribution Functions 
for Certain Nonlinearities 


The method of analysis described in this 
paper is quite different from that of Booton's. 
Essentially, the rms value of the output noise is 
found as the second moment of a simple output pro- 
bability distribution function. Of course, this 
assumes that the noise is ergodic; that the time 
averages are the same as amplitude averages, and 
therefore time averages need not be considered in 
determining rms values. The output amplitude dis- 
tributions are found quite easily from certain 
types of single valued nonlinearities which often 
appear in filters and control systems with or with- 
out feedback, This is done by assuming that the 
input amplitude distribution to the nonlinear 
device is known. The principle involved is shown 
in Figure 2, Here the input distribution is shown 
as a Gaussian function, although the principle is 
not restricted to this particular amplitude dis- 
tribution. Actually, a Rayliegh exponential, or 
any other known distribution could be substituted 
for the Gaussian distribution shown. 


A discussion of the saturating nonlinearity 
in Figure 2a will illustrate how the output dis- 
tributions are obtained. From the nonlinear 
saturating characteristic shown in Figure 2a, it 
is evident that the output amplitude cannot exceed 
the limit levels + L. Therefore, the probability 
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that the output will exceed Lis zero. This indi- 
cates that the area of the output distribution 
from -co to -L and from +L and +> must be zero. 
However, since the nonlinear function is actually 
linear between -L and +L, it is assumed that the 
output distribution is the same as the input 
amplitude distribution in this region. Therefore, 
the probability that the output distribution will 
be the same as the input distribution in the 
central region is the area of the input distribu- 
tion between the amplitudes -L and +L. This is 
2Ao in the figure. The probability that the 

input amplitude will exceed these limits is equal 
to the areas of the input distribution between 

-oo to -L and the area between +L to +oo. Each 
area is equal to .5 - Aj because the total area of 
a probability distribution function is unity. It 
follows that the probability of the input exceeding 
the linear region is the same as the probability 
that the output amplitude will be exactly +L. This 
is represented in the output distribution by im- 
pulses of area (.5 - Ap) at +L. By using this com 
cept, the output distribution has a total area of 
unity while maintaining the same distribution as 
the input between +L with zero area outside these 
limits. 


In Figure 2b the same reasoning also applies. 
Here the output amplitude can be only -E, 0, or +E. 
This condition is represented in the output dis- 
tribution by three impulses—one at -E, another at 
O, and another at +E. The impulses are assumed to 
have zero widths, infinite heights, and finite 
areas for convenience. The areas are equal to the 
probabilities that the amplitudes will exist at 
-E, 0, and +E, respectively. Of course, the pro- 
bability that the output amplitude will be +E is 
the probability that the input amplitude will ex- 
ceed +L. This is equal to the area (.5 - Ao), 
represented by an impulse at +E in the output dis- 
tribution. The same applies to the impulse at -E. 
The area of the impulse at the center represents 
the probability that the output amplitude will be 
zero. This is equal to the probability that the 
input amplitude will not exceed +L, the area of 
the input distribution, 2A,, between +L, The 
figures, 2c, 2d, and 2e, show other examples of 
probability distribution deduced from the opera- 
tion of different nonlinear devices. Obviously, 
impulses can be used to represent the outputs of 
other types of nonlinearities which may be repre- 
sented by discontinuous functions. 


Once the form of the output distribution has 
been established, it becomes a relatively simple 
matter to compute the rms value of the output 
function because it is the square root of the 
second moment of the distribution. For the satur- 
ating nonlinearity, the problem is similar to that 
of finding the radius of gyration of a flat plate 
shaped like the input distribution with two right 
angle bends at +L.* 


This method has the advantage of providing a 
physical interpretation of the mathematics involved 


*Actually, this would be the radius of gyration 
projected into the plane of the plate. 
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in finding the rms output of a nonlinearity. From 
a pictorial representation, it is usually easier 
to estimate how the output will change with varia- 
tion in the nonlinearity. Graphical methods may 
be employed with almost any degree of accuracy de- 
sired or more exact mathematical calculations can 
be used, and the calculations are relatively 
simple to make because the moments of many distri- 
bution functions have been calculated and tabulated. 
For example, Figure 3 is a plot of the zero, first, 
and second moments of a Caussian distribution be- 
tween O amplitude and any amplitude L. Because 
the moments vary with the rms value of the input 
distribution, the curves have been plotted in 
terms of Sy/L, where Jy is the rms value of the 
input.** Note that the curves give values for 
only half of the distribution. When plotted this 
way, it is possible to consider non-symmetrical 
functions, those with a bias value, as explained 
in another section. It should be noted that the 
zero moment, Mo, is the area of the distribution 
between O and L, the first moment, M,, is the 
average amplitude, and the second moment, Mo, is 
the average of the amplitudes squared (the vari- 
ance, the squared’ value, or the rms value squared) 
also evaluated between amplitudes 0 and L. 


The second moments of some of the outputs 
distributions shown in Figure 2 are extremely 
easy to calculate. For example, the second moment 
of the distribution in 2c is simply 2E2Ao, and in 
the output distribution 2b, it is 2E* (1/2 - Ao) or 
E*(1 - 249). The rms value is EVI — 2Ao. This 
can be evaluated by referring to Figure 3, where 
Mo is the same as A, in Figure 2. 


All of the output functions of Figure 2 have 
a zero mean value, or zero D.C, value because the 
distributions are symmetrical with respect to zero, 
This is easily verified by computing the first 
moment of the areas and adding them algebraically. 


For example, in Figure 2b, the first moment, 
the D.C. value of the output, is +E(1/2 - Ao) 
-E(1/2 - Aj) = 0. It is interesting to compare 
this method of calculating the rms output of a 
nonlinear device with that proposed by Booton. 
The calculated results of each method are plotted 
in Figure 4 for a saturating component and in 
Figure 5 for a relay device. Although the methods 
are entirely different, the results are quite 
similar. It appears that the output values for 
the relay device generally vary more widely than 
those of the saturating device, but the average 
discrepancy is only about 10 percent. 


To obtain a check on the calculation, a 
random noise generator (General Radio No. 1390A) 
was connected to a Zener diode which simulated a 
saturating device. The rms value of the saturated 
output was read directly as an rms voltage (using 
a Ballantine rms meter No. 320), and the rms value 
of the output voltage was divided by the rms value 


**The square root of the variance, 


of the input. These experimental results, plotted 
in Figure 4, appear to agree with Booton's where 
the rms value of the noise is small compared with 
that of the saturating limits. However, at higher 
values of noise it apparently deviates toward the 
values computed from the amplitude distributions 
as described in this paper. Because the measuring 
devices were not precisely calibrated, another 
method was used to check the calculations experi- 
mentally. 


The other method used to check the calcula- 
tions was basically numerical—a digital computer 
(IBM 704) was programmed to compute the rms value 
of a random set of numbers that were subjected to 
a predetermined limit. This is the basic mechanisn 
of an actual saturating device with a random input 
except that a relatively small sample of numbers 
was used to define the input instead of an infinite 
number which should be used theoretically. To 
check the number of random values that would 
approximate a noise input, several different 
numbers of values were used. In Figures 4 and 5 
the noise describing function obtained from the 
computer using 200 and 400 values are shown. * 


Of course, this is another method of calculat- 
ing the noise gain or describing function, but it 
is difficult to obtain the insight or engineering 
perspective that the amplitude distribution gives, 
and it is not always certain that an optimum 
number of random values are being used.** However, 
the most interesting results of the digital com- 
puter calculations are that the noise describing 
functions obtained appear to agree very closely 
with those obtained from the amplitude distribu- 
tion method. This is shown in Figures Avand 5: 


Non-Symmetrical Distributions 


Because the moments of the output amplitude 
distributions in Figure 2 can be calculated rather 
accurately and easily when they are partially 
represented with impulses, it is a simple matter 
to extend the method to non-symmetrical distribu- 
tion functions, those with a first moment, M1, or 
a D.C. component in the output function. This dis- 
tribution is typical of many filters and control 
systems where noise is superimposed on signal in- 
formation which may be considered as a slowly vary- 
ing, predictable bias or D.C. level. Of course, 
the transmission of the noise and bias signal may 
be calculated separately and the results combined 
in a linear device, but in a nonlinear component, 
superposition does not apply—the transmission of 
the D.C. component is modified by the amount of 
noise present and the transmission of the noise is 
influenced by the magnitude of the D.C. component. 


*The number of values was increased to 600, but 
there was little difference between the outputs 
for the 600 and 400 sets. 


found that a very large 
number of random values 4s needed to calculate a 
D.C, level in the output of a saturating device 
if it is less than .3 of the rms noise level. 


**For example, it was 
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The interrelations between the D.C. input, M, 
and noise input are represented by ~X, and are 
illustrated in the output distribution shown in 
Figure 6b for a saturating element and in 6c for 
a relay device. Note that the impulses in these 
distributions are the same, but that the moment 
arms are different. The areas of the impulses 
which contribute directly to the output noise are 
obviously functions of the input bias, M, the type 
of nonlinearity involved, and the rms value of 
the noise, oX. 


The first and second moments of the output 
distributions 6b and 6c can be computed from 
moment values obtained from Figure 3. The moments 
of Figure 6c may be obtained directly,f but the 
moments of the distribution in 6b must be obtained 
with respect to the zero reference of the input 
distribution although the moments in Figure 3 are 
computed with respect to a normal distribution 
with zero mean. However, the method of calculating 
the output distribution moments and the rms value 
of the output function from the three basic curves 
in Figure 3 is described in Appendix I. 


The relationship between the D.C. bias and 
rms value of the input, the characteristics of 
the nonlinear device, and the D.C, bias and rms 
value of the output are shown more vividly in 
terms of equivalent gains or describing functions. 


The describing function for a nonlinear ele- 
ment with an input consisting of a combined noise 
and bias signal actually consists of two functions: 
Dj» @ bias signal transmission function, and 
De , a noise signal transmission function. Each 
function is influenced by its ow input as well as 
the input to the other. Thus, Dp = f(M, oX, N) 
and De = f(M, oX, N) where M is the input bias, 
oX is the rms value of the input noise with 
respect to M, and N is the particular nonlinear 
characteristic. This over-all describing function 
is represented by the block diagram in Figure is 


The functions, Dp, and Dg , were calculated 
and plotted in Figures 8 and 9 for a saturating 
element and in Figures 10 and 11 for an ideal 
relay device. The curves indicate how the 
signal and noise transfer ratios vary with respect 
to nonlinearity and the signal-to-noise ratio at 
the input to the nonlinear devices. A digital 
computer and an analog computer were used to sub- 
stantiate the theoretical calculations as shown 
in the figures. Generally, the curves verify in 
a quantitative way the operation that might be 
deduced qualitatively. 


t The first moment is E(.5-Ao1) -E 5-Ao2) = 


2 


E(Ag2-Ao1), the second moment is E“(.5-Ao}) 
482(.5-Ag2) = Ee fi - (Ao1 +Ao2)} , and the rms 
value of 


Be [1 - (Ao1#Ao2)) - E*(Ao2-Ao1)*. 
Numerical values for Aog and Ao) are found from 
Figure 3 as shown in Appendix I. 


The Saturating Describing Function 


In Figure 8, the D.C. describing function, 
Dms, through a saturating device is unity only if 
the D.C. input signal, M, and the rms input noise, 
oX, are less than .25 of the saturating level. 
However, as the D.C, input, M, approaches the 
saturating level, L, the effective signal transfer 
ratio, M,/M, becomes considerably less than the 
expected gain of unity—if the input noise,oX, 
becomes equal to or greater than the saturating 
level. Of course, as the D.C. input level be- 
comes greater than the saturating level, the D.C. 
gain becomes less than unity. However, even in 
this operating condition, the gain becomes pro- 
gressively smaller as the input noise becomes 
greater because, as the input noise becomes more 
predominate, it becomes more evident at the satu- 
rated output. Since the noise peaks are always 
less than the saturating level, the average value 
of the output must be less than the saturating 
level. 


Figure 9 indicates that the noise describing 
function, Dos, will be essentially unity for the 
saturating device until the rms value of the input 
noise becomes greater than .4 of the saturating 
level—if the D.C. input signal is essentially 
zero. However, as the D.C. input becomes greater, 
the effective noise transfer ratio, g-,/oX, be- 
comes smaller. When the D.C. input exceeds the 
saturating level, the noise transfer ratio is zero 
for small values of noise. Then as the input noise 
increases To/ ox reaches a maximum value, although 
less than .5, and then it decreases slowly toward 
zero as the rms input noise becomes much larger 
than the saturating level. 


The Relay Describing Function 


If a small D.C. input signal is applied to 
the input of the relay device along with random 
noise, a D.C. level appears at the output.* How- 
ever, as shown in Figure 10, the D.C. describing 
function, Dyr, is essentially zero if the input 
signal and rms noise are only .25 of the relay 
closing level, L. However, as the noise is in- 
creased, the D.C, level at the output becomes 
more pronounced, the transfer ratio increases to 
a maximum nearly .5, then it decreases toward 
zero as the noise input greatly exceeds the relay 
closing signal, L. 


The noise describing function, Drp, for the 
relay is shown in Figure 11. It is interesting to 
observe that as the input D.C. level, M, becomes 
equal to the relay closing level, L, a very large 
amplification of noise occurs. Theoretically, the 
transfer ratio is infinity because all noise ampli- 
tudes, even those essentially zero in the input, 
are transformed by the relay into finite output 
values equal to E. However, as the rms value of 


*For small signal-to-noise ratios, this is rather 
difficult to detect. A long time or large sample 
is needed to obtain accuracy. 
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the input noise increases, the transfer ratio de- 
creases rapidly because the output noise or volt- 
age is limited. As the D.C, input signal is in- 
creased, the relay opens, or chatters, on noise 
impulses creating output noise. Thus, the noise 
transfer ratio is essentially zero when the D.C. 
input level exceeds the relay closing level, 
M/L>1.0, but as the noise level increases, the 
noise transfer ratio increases, reaches a maximun, 
then recedes toward zero as the input noise greatly 
exceeds the relay closing level. 


Use of Noise and Signal Describing 
Functions in Closed Loops 


The previous discussions have involved non- 
linear elements that might be found in amplifiers, 
networks, or measuring devices which are not necés— 
sarily in feedback control loops. Nevertheless, 
it is possible to use the representative describing 
functions in a closed loop. However, because the 
signal and noise levels at the output of the non- 
linearity depend on the signal and noise levels at 
the input to the nonlinearity and because both 
noise and signal input levels are functions of the 
feedback signal and the other elements in the loop, 
special innovations and considerations are neces- 
sary to obtain the noise and signal levels in the 
loop. The principles involved will be shown ina 
simple example and the results confirmed with 
experimental data, but first it is necessary to 
discuss two preliminary assumptions that will be 
made: (1) the noise input to the nonlinear device 
in the loop has a Gaussian distribution,** and 
(2) the shape of the noise frequency spectrum at 
the output of the nonlinear device is not greatly 
altered by the nonlinear element. 


The assumption that the input noise has a 
Gaussian distribution is an engineering assumption 
commonly made and approximately justified when 
devices with relatively low bandwidths are used in 
the feedback control loop.f Thus it is assumed 
that even the rather strange and non-symmetrical 
amplitude distributions involving impulses in 
Figures 2 and 6 will be redistributed in the form 
of Gaussian functions by low band pass elements in 
the feedback loop before they reappear through the 
feedback path to the input of the nonlinear element. 


The other engineering assumption that will be 
made is that the frequency spectrum of the noise 
will not be greatly changed in shape by the non- 
linear device. There are several reasons for justi- 
fying this assumption: (a) it is assumed that the 
nonlinear devices have no frequency sensitive 


**Noise rectification is not considered in the 
example, but it could be analyzed in a similar 
manner, 


t This is proved rigorously for certain types of 
random inputs in reference (8). 


elements, (b) work by Middleton,* Lawson and 
Uhlenbeck,** and Smith? indicates that the fre- 
quency spectrum is not greatly changed after pass- 
ing through a nonlinear element,f (c) usually the 
control system bandwidth is much smaller than the 
noise bandwidth and only the rms characteristic 

of the noise is significant. With these assump- 
tions, the closed loop analysis can be made to 
find steady-state operating conditions. 


The method of using the describing functions 
is outlined in Figure 12 for a saturating element 
in a simple type 1 position servo’ subjected to a 
ramp input X; = Xyt # and random noise character- 
ized by the power density function: 


20-4” ®o 
Satna opie 


The nonlinear element following the error signal 
in Figure 12 has a gain Kj, actually representing 
the describing function, Dys, for the steady-state 
error, Egg, and a gain, K2, representing the de- 
scribing function, Dr,, for the rms noise, yg, in 
the error signal. As shown previously, each 
effective gain is a function of its own input as 
well as the input to the other gain, and each 
input is a function of the closed loop. A graphi- 
cal solution of the simultaneous equations involved 
is obtained rather indirectly by first assuming 
values for the steady-state error and the rms 
noise in the error signal and then solving for the 
respective ramp and noise inputs that would pro- 
duce the assumed error signal and noise in closed 
loop operation. As shown in Figure 12, the expres- 
sions relating the closed loop errors and inputs 
are 


*Reference (3). Here Middleton shows that the 
frequency spectrum of wide band noise (noise with 
D.C. components) is not changed greatly by recti- 
fication and limiting. 


**Reference (4). The authors show that a narrow 
band noise frequency spectrum is not altered 
greatly by severe clipping. The largest change 
of the frequency spectrum is in magnitude. 


fActually, the describing functions were developed 
without considering the noise time function of its 
frequency spectrum. This was done on the assump- 
tion that the random function was stationary and 
ergodic, that the amplitude averages were the same 
as the time averages. Of course, if the rms value 
of the output is different from that of the input, 
both the autocorrelation function and the power 
density function of the input must change. Here 
it is assumed that the output power density func- 
tion changes with respect to the input density 
function in amplitude only so that its area is 
equal to the square of the rms output. 


tin a linear system the steady-state error for 
this input would be a constant proportional to Ky. 
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Each function is plotted as shown in Figure 3 
against a common noise error abcissa, op, for 
various values of Egg. The steady-state error, 
Ess, and noise error, og, in the closed loop for 
any particular ramp input and noise input are 
found from the resulting graph by entering the 
graphs along horizontal lines at the ordinates 
representing the given ramp and noise inputs. 
These horizontal lines are extended to the right 
until they intersect steady-state error curves, 
Ess, which have equal values on a common vertical 
line representing the noise error, gg. The 
common values of Egs and oR found in this way 
are the steady-state bias error and noise error, 
respectively, for the given noise and signal 
inputs. Figure 14 shows the steady-state errors 
and noise errors for various ramp inputs as 
obtained from the graphs in Figure 13. It should 
be noted that if the assumed system were linear 
and without noise, the steady-state error, E,., 
would always be equal to the input. However, as 
the rms value of the input noise increases in the 
nonlinear system, the steady-state error becomes 
larger. 


The results of this analysis were verified on 
an analog computer, and the experimental results 
are also shown in Figure 14. Figure 15 isa 
recording which shows how the loop variables 
appeared as time functions in the analog model. 


It is interesting to note in Figure 13 that 
if Xy/L becomes unity, there is no intersection 
with a steady-state error curve, Ess, if there 
is a noise input, except in the limit when Ess 
approaches infinity. Ordinarily, without noise, 
the error would be unity, not infinity. There- 
fore, it would appear at first that the graph 
may be incorrect. However, this condition was 
simulated on the analog computer and the results 
are shown in Figure 16. As shown, the steady- 
state error grows larger, and this reduces the 
noise in the saturating element output, Eg. How- 
ever, to maintain the desired output velocity, 
Eo must have a steady-state average value of 
exactly 1.0, but any noise which appears reduces 
this average value, as indicated in Figure 16. 
Therefore, no noise must appear at E,, and to pre- 
vent this, the D.C, input, Ess, to the nonlinearity 
mist become larger and larger. Theoretically, 
noise may have infinite peaks, and therefore, 
theoretically, Es, must become infinite to prevent 
noise from appearing at E,. Of course, the D.C. 
level at Eo cannot exceed the saturating level 
which is equal to unity. As indicated in the 
analog computer runs, the D.C, error is growing 
slowly and it does not reach a steady-state 
value although it is 6.5 times the expected 
linear level. These analyses indicate that, if 
a servo is subjected to noisy ramp inputs, the 


saturating levels must be large enough to prevent 
an unexpected increase in the steady-state error 

signal. Of course, the D.C, levels and noise in 

other parts of the loop may be calculated if the 

error signals are known. 


Conclusions 


It has been shown quantitatively that the 
transfer of a noisy signal through a nonlinear 
element is a function of the magnitude of the 
signal and noise, the signal-to-noise ratio, as 
well as the type of nonlinearity involved. The 
over-all transfer function may be considered as 
a special describing function with two parts—one 
for the noise, the other for the signal, each a 
function of the input to the other. This is in 
accordance with the fact that superposition does 
not apply if nonlinear devices are involved. 


It has also been shown that the steady-state 
operation of a control loop with nonlinear elements 
subjected to a combined random and deterministic 
bias signal, or D.C. signal, can be predicted 
using the describing function developed. 


For the special case where the bias signal 
or D.C. input to the nonlinearity was zero, the 
describing functions were in relatively close 
agreement with those developed by other investi- 
gators as noted. However, it is hoped that the 
methods used here to develop the describing 
functions from the amplitude distribution functions 
will provide another method and a deeper insight 
into the more general problems involved and, in 
so doing, perhaps permit relatively rapid, although 
approximate, calculations of noise and signal 
transmission through nonlinearities—particular 
for engineering purposes. 
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APPENDIX I 


Graphical Evaluation of Nonlinear Output Bias and RMS Values 


As suggested in the section on non-symmetrical 
distributions, the bias and rms values of the out- 
put of a nonlinear function can be computed from 
standard moment curves such as those shown in 
Figure 3. 


A non-symmetrical input distribution is 
shown in Figure 6, The normal input distribution, 
Figure 6a, has a D.C. bias, or first moment, M, 
and a variance ¢X*. The output distributions 
from saturating and relay devices are shown in 
Figures 6b and 6c. The first moments about the 
X = 0 reference represent the D.C, output level 
and the second moments represent the mean square 
value of the output. These moments are easily 
calculated as shown in the text for the relay 
device. 


However, the first and second moments for the 
output of the saturating device are not as easily 
obtained, although the following method makes a 
graphical solution possible using the curves in 
Figure 3. 


; The first moment in Figure 6b may be repre- 
sented by: 


+L 
14 J, tex )anek(5-ho1)-L(-5-Hoa) 


+L 
v= M[Al = #My th (5A )-L(.5-Ao2) 


10 


+L 

where [A] _ = Ap = A,j*Agp (defined by the shaded 
-L areas in Figure 6a) 

= My (M PE Ck L) MT, (-L <X<™M). 


and My 


As shown, Ag1 < Aga: and normalizing: 


een Pe ¥ Mix Mx Mix Max 

T rad L(1-#) Boz Aor (Aog*Mor) plat) Mog-Mol Gy ox “ LE EL OM 
Sates ORIN TOS ISLs) 0928 vase? = Bab, 280 27511105 —20525 297551990 
1.0 Ite ce ing pe Ne, 5668 4167 422. % 2225 5100.<.125 i125 2.16451 .658 


Table I 


*These columns add to equal Mj0/L. 


Mo .M Mix 
eee Seletos ae ote tts nozetol a 
The Aj) and A., values can be found from the 
Mp curve fn Figure 3 by redefining the abcissa 


7 X/L to be J X/L(1 - M/L) when finding A,) and 
OX/L(1 + M/L) when obtaining Ag2, 


My and Mjy can be found in a similar way 
from the Ky / X curve in Figure 3. In this case, 
the values found from the curve are multiplied 


by 6 X/L. 


For example, if M/L = .25, Table I may be 
made from Figure 3. 


The second moment for the saturating element 
may be calculated in a manner similar to that 
used to find the first moment. 


‘ 2 2 2 
Noo * ; (M+X)“ dA4L*(.5-A,) 4L°(.5-A55) 
L +L 
Mog = MAp+2M i XdA +( X7GA4L7-17A,, 
-L -L 
Mog = (MP-L?) Ap + 2M(Myx) + Moy + Ea 
where Moy = MSY (M < X <L) + Moy(-L<X <M). 
(Moy can be evaluated from Figure 3 ina 
manner similar to that in which M,y was derived.) 
Normalizing: 
M20 _| (ui? yw (Mux), Mex | 3 
Yao = [f)- Ap + 27 pe Pe ee 


Finally, the desired rms value, %, about 
the output bias level is found from 


= g Meo ~ M07 ary (cae, vallteral 
L2 Te Te o- 1G IX 


vy M10 2 (*2| {t}. This is the desired output-input ratio plotted in Figure g. 
M L M 


fPound from Figure 3. 
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Fig. 4. Noise transmission through saturating device. 
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Fig. 5. Noise describing function, Dg (no bias). 


Fig. 6. Nonsymmetrical distribution functions. 
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Fig. 7. Describing function for signal and noise. 
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Fig. 8. DC describing function Dyg. 
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Summary 


The space stabilizing capability of a servo 
controlled nonrotating inertial mass is analyzed 
and its drift rate performance compared with a 
high precision gyroscope. The results indicate 
that the nongyroscopic inertial reference and 
guidance system exceeds the performance of gyro- 
scopic systems by several orders of magnitude. 
It is shown that a servo system materially con- 
tributes to the drift accuracy in the nongyro- 
scopic system but not in the gyroscopic system. 
The navigation errors of the discussed scheme 
are directly proportional to the accelerometer 
errors and, therefore, are inherently smaller 
than in an equivalent gyroscopic system. 


Introduction 


The major part of the material presented in 
this paper was generated in December 1951. At 
that time, a significant effort was in progress 
at Government agencies and private industry to 
develop high precision gyroscopic instruments 
for long range inertial navigation. The initial 
objective of this study was to investigate ways 
and means to develop simple and inexpensive non- 
gyroscopic space reference systems of low per- 
formance for target missile application, etc.* 
Although it soon became apparent that the poten- 
tial of the applied concept was more in the 
field of ultra precision space reference systems, 
not much interest could be generated to extend 
these investigations in competition with the 
effort in the gyro field. 


The presentation of this material is moti- 
vated by considerations of present efforts to 
develop what is commonly referred to as "exotic" 
gyros among which nuclear concepts appear to 
predominate. The reasons for this new effort 
originate from the requirements of future space 
flight navigation with emphasis on long opera- 
tional life times, high accuracy and low power 
consumption. 


Concept 


The implementation of inertial guidance 
systems invariably calls for gyroscopic instru- 
ments of one kind or another. Newton's three 
laws which represent the basis for inertial 
guidance do not prescribe a gyro in such a 
system. It is, therefore, justified to inves- 
tigate the possibility of implementing an iner- 
tial guidance system without the use of gyros. 


In this investigation, the stabilizing 
capability of a nonrotating inertial mass is 
determined and the performance of this system is 
compared with a gyroscopic system. The compari- 
son is facilitated by the postulation that no 
time limit of stabilization exists in either 
system. The procedure requires the application 
of servo loops around the inertial mass and the 
gyroscope. On the basis of the transfer func- 
tions and steady state solutions, a term by term 
comparison is possible and the drift rate per- 
formance can be established. Only the fundamen- 
tal. behavior will be discussed. 


If a nonrotating inertial mass is placed in 
a controlled environment in such a way that the 
forces and moments acting on this body are pre- 
dictable and consistent, it is possible to reduce 
their effects by servo compensation to negligible 
or vanishing values. In this manner, the state 
of rest or motion of this body in the inertial 
reference frame is preserved and thus can be used 
as an angular reference. 


A possible implementation of this scheme is 
indicated by Figure 1. The prime element is a 
cylindrical body of glass which is housed in a 
sealed container of similar shape. The container 
is filled with a low viscosity fluid of the same 
density as that of the glass body and keeps this 
body in a submerged floating condition. The 
temperature of the whole assembly is accurately 
controlled in a manner equivalent to that applied 
to HIG gyros. The glass wheel is kept in place 
by thin torsion bars of quartz. The container is 
supported by conventional ball bearings with the 
axis of rotation coinciding with that of the 
inner wheel. 


A torque free photoelectric or capacitance 
type of pick-off measures the relative motion 
between the wheel and container and supplies 
control signals to small compensation torque 
coils between wheel and case as well as to power 
torque motors between the case and its carrier. 
In addition, a linear accelerometer is mounted 
on the case, the output of which is used to pro- 
vide a control signal to the compensation torque 
motors and the guidance computer if one is used. 
This system corresponds to a single axis inertial 
platform and may be expanded to a three degree of 
freedom device. 


General Performance Functions Of 
Servo Controlled Inertial Wheel 


At the stabilized floatation temperature, 


* This study was encouraged by F. H. Andrix, Chief Engineer, Avionics Division, Bell Aircraft 


Corporation, Buffalo, New York 


the disturbing moments acting on the glass body 
are: the restoring moments of the torsion bars 
due to the relative motion of the container and 
glass body, the viscous shear moments due to the 
relative angular velocity, and moments due to a 
residual pendulousness in a gravitation and/or 
acceleration field if a displacement of the 
centers of mass and buoyancy exists. The dis- 
turbing moments can be relatively easily deter- 
mined by measuring the natural frequencies and 
the damping behavior of the glass body. 


Introducing the compensation torque with 
gains Gy for damping, Gp for torsion and G, for 
pendulousness and linear acceleration, the 
equation of motion of the inertial wheel is 
found as 


{iwP'+ k-ay)0 + [(e-6,)+IyWerhE 


= {Ck-G)P+[0-Gr) +Gyg TH P 


+ (4 wea Ga 


The equation of motion of the case can be 
approximated by 


IeP* etic =m (2) 


in which Mp may represent a disturbing moment 
due to bearing friction between case and its 
support. Mc is the control torque in accordance 
with the control equation 

(3) 


(%P+70t Z!)(e- E)= me 


From equations (1), (2), (3) the motion of the 
case can be determined as 


(PA Rt+ARItAR thy PIAs) © 
ss M, 
=(72+8 P18.) P Fe (4) 


+2 GP 1g6P 19:41 inp ~ GAY) & 
c Lipa: 


(7) 


ab aes the physical quantities 


k= =u (5) 
C= mye ur T 
The coefficients A; and By become 
Ff a 6 
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Aq= 3 (Wie - SF) 
As = 22 Winp -~t 
lat ah 

Be= Wi twe,,-So 


The steady state solution for a constant 
disturbing torque Mp on the case and a constant 
horizontal acceleration can be approximated by 


: # (-eunr SRE t) @ 


and the drift rate 


ee g Were VI eee Mare @) 
y/- GAG, é 


"Wt 3 
If the acceleration compensating gain is chosen 
as: ]@ 
(apie $+ (9) 


and an accelerometer accuracy of 


= Va 
is assumed the drift rate at the end of accel- 
eration phase is 
(70) 


Pox Wes ya (xe) 


V is the horizontal vehicle velocity gained 
during the constant acceleration period. 


If by virtue of a very low wheel pendulous- 
ness and a highly accurate acceleration measure- 
ment a nearly perfect compensation is achieved 
the equation of motion, (4), reduces to 

”) 


gee Hernia) eC 
=(fa “¥8Pr be) oe 
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The steady state solution of (11) for a constant 


Bs=(we, — 


Mp is 
p. =(/~ 2. Mer Tw \(F To), 
Ww 
G 
we ee 
ae wT Iw Mpt 
7-) %, (12) 


(13) 


As can be seen by inspection of the coefficients 
Ay ‘the dynamic behavior of the third order 
system is primarily determined by the gains &1> 
Bo and &-,- In order to obtain a reasonable 
estimate of the gain magnitudes involved it is 
postulated that the negative real root is a 
multiple N of the negative real part of the com- 
plex roots. In tuis manner the coefficients A; 
and B; may be represented in terms of the closed 
loop control system frequency, Wo and damping 
1 Application of this procedure yields 
the following relationship: 


Me Pe 
fe (24N) PW 


Az x = () +2Ne2) We 
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With these expressions the steady state 
rate due to a constant friction becomes 


A, 


(14) 


drift 


G 
2 ee (5) 


with a compensation gain of 


2 
Wa rly 
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and an accuracy of compensation No one obtains: 


- Wir tr Mp 
Ps = WP wes Le 


General Comparison With Gyro System 


For the purpose of comparison a precision 
air bearing gyro with servo compensation similar 
to the scheme presented in Ref. 1 is chosen. 
According to Fig. 2 the equations of motion of 
the measuring () axis and precession (0C) axis 


(6) 


2 c 
I, P ? + HP < +M- =Mp ¢ 
(IXP24+KgP)X<-H PP EMpe (7) 


The control torque Mc on the axis is 
obtained from the precession angle o¢ and is 
chosen as 


(78) 
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The system equation of motion is then 
(y) 
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The steady state solution for constant disturbing 
torques such as dry friction Mp» and a mass 
unbalance or turbine torque Mp og is: 
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In order to facilitate the performance 
comparison of the compensated and servo con- 
trolled inertia wheel with a high performance 
air bearing gyro, the physical system parameters 
yielding the same drift rates in either system 
are compared with each other. Thus the drift 
rate due to an air bearing turbine torques 
Mpe¢T as compared with the drift rate of the 
inertia wheel system due to incomplete torsion 
bar compensation but perfect acceleration 
compensation is established as 


If the ratio of disturbing torques to inertias 
Z is introduced such that 


Pa Det Tikes 
Mpe we (23) 
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the following relation between gyro rotor speed 
and the servo parameters Wo,N and ff is 
obtained 


NIWe 3 
Wewror 


ia) (24) 


A conservative assumption of the quantities is 
as follows: 


N= /0 Mp yp akg 
by ene OF, Re 
M 
Ww, = 2000 ot = 79° 
» ; Iwe 
1 ik) 
Z=/05> 
Wr = ol 


With these values an air bearing gyro yielding 
the same drift rate as the servo compensated 
inertia wheel would require a rotor speed of 
the gyro of 


2256x707 
~ 5.6 X/0" RPM 


Similarly, the drift rate due to an unbalance 
torque on the gyro precession axis as compared 
with the drift rate of the inertia wheel system 
due to incomplete pendulousness compensation can 
be established. The gyro unbalance torque con- 
sidered here is caused by a center of gravity 
shift of the rotor due to nonideal bearings and 
assymetrical geometry changes due to heat flow 
from the gyro motor. The unbalance torque of 
the gyro in a gravitation and/or acceleration 


field may be expressed as 
(25) 


so that the following relation exists between 
the two systems: 


mae 
Mpec p = Hoc p Tec o 
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Since the drift rate of the servo controlled 
inertia wheel system is proportional to the 
velocity gained during an acceleration phase, 
the comparison requires a specification of 
acceleration and velocity. With the following 
assumptions: 


ae Me, 25s of 
ie eas =. 5, Vie /0 ) 
1G 7,210" 
Wep=5XxI0F  gs-! 

Wwe =/073 Si 


the required gyro rotor speed yielding the same 
drift rate as the inertia wheel system would be 


tu xv l.25 xI105 
125 x 10% rpm 


Accuracy Limitations 


Disturbances acting on the glass body that 
cannot be compensated are those caused by Brownian 
motion and temperature field gradients, which lead 
to rotational motion of the floatation medium and 
eventually to a drift rate of the inertial wheel 
system. The random drift uncertainty due to 
Brownian motion can be estimated from 


i (SE. 
A ~ c— = 

ye wr )rlw 10 deg. 

(27) 

where K is the Boltzmann constant and T is the 
absolute temperature. The exact determination 
of the flow field in the floatation fluid due 
to temperature gradients is beyond the scope of 
this paper. However, on the basis of the funda- 
mental behavior of a viscous fluid with density 
variations in a gravitational field as derived 
from the Navier-Stokes equations in connection 
with heat transport and heat conduction the 
tangential flow velocity U on the wheel can be 
derived as 


Soo eee, 
ee ar gH & emt sinft 
z (28) 
in which 
i) ip 
H=2t e 
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with 


r, =6cm 
F = 3:.cm 
AT = .0/ deg, c 


T= 300 deg. Kelvin 


one obtains 
~9 y 
Ux 10 emsrl 


and 


Ag im jon deg. eae 


The integral over the statistically distributed 
velocities around the glass body, however, will 
yield a much lower net value. A velocity profile 
is shown in Fig. 3. Inaccuracies in the tempera- 
ture level control affect the pendulousness of 
the wheel in the following manner: 


2 BY ge <P ) § wW 
ee 
SF (29) 


Since, however, the acceleration compensation 
gain Gy can be adjusted automatically to the 
actual fluid temperature by means of a multiplier 
resistor in the fluid a better than 95% campen- 
sation of this effect which in itself is small 
can be achieved. 


Applicable Technology 


It is evident from the discussion of the 
various error sources that the wheel should have 
a high dimensional stability and accuracy as well 
as a high degree of homogeneity. A cylinder of 
glass of optical quality appears to fulfill 
these requirements very well. Also, the methods 
of high precision shaping are well established 
in the optical industry. In addition, glass is 
corrosion resistant and a great variety of den- 
sities can be achieved. The requirements on 
linearity and hysteresis of the torsion wire 
suspension can best be fulfilled by quarts which 
is extensively used in high precision measure- 
ments. As floatation fluid methylene bromide 
(CHp Bro) having a density of 2.46 gem@3 at 30 
deg C may be used. It has a melting point of 
-52.8 deg C and a boiling point of 97.8 deg C. 
The viscosity is low and amounts to 1.225 
centipoise at 25 deg C. If the wheel configura- 
tion has a moment of inertia of 1 cmg s@ and a 
spacing of 3 cm is chosen the time constant will 
amount to approximately 300 seconds and no com- 
pensation for viscosity is required (G20). 


A relatively crude experimental two metal 
combination (magnesium and copper) wheel verified 
the obtainable time constants. The pendulousness 
was established as W,,=3x1073 s71 inspite of 
corrosion difficulties. It is expected that a 
good glass wheel will have value of Wypz1074 s-1 
or better. Capacitance type of transducers or 
optical pickoffs may be used to furnish the com- 
pensation and control signals. Since the torque 
level of the compensation is very low galvanome- 
ter type of torquers with a few windings are 
applicable. 


The servo motor between case and vehicle 
frame should not introduce disturbances due to 
airframe motions. For this reason, gears should 
be avoided and direct torquers be used. DC 
torquers with permanent magnet excitation are 
favored over other schemes for reasons of overall 
efficiency. Since solid state devices such as 
transistors or controlled rectifiers should be 
used in the power amplifier a pulse modulation 
scheme is preferable. A possible scheme is shown 
in Fig. 4. This method makes use of a polarized 
relay as tne modulation element but equivalent 
circuitry can be developed which would result in 
a@ similar operation. 


The relations between 
signal flux, @ , feedback flux gz and dead 
zone flux Hp are shown in Fig. 5. A first 


order analysis yields an "on" time of 


7 27H 1 


4 - — 


2 oh. (3o) 


where P is the ratio between signal and feedback 
flux the "off" time is 


27 Do 1 
7, LZ. es 


The frequency of the modulation is then 


fy = Me P-P* 
jae oe CL) 
so that the modulation is 


™ _ Fim UP aad 


With this the effective control voltage V accross 
the torque motor in relation to the power supply 
voltage Vo is obtained as 

(34) 


Ve 
Va Ve og 


° 
These relations are plotted in Fig. 5. 


(32) 


(33) 


Potential Application 
Terrestial Navigation 


The servo controlled inertia wheel system 
is ideally suited for long range terrestial 
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navigation if it is operated in the Schuler tuning 
mode. The equation of motion of the angular 
reference which indicates the local vertical un- 
disturbed by vehicle acceleration is similar to 
(4). The acceleration compensating gain has to 
be adjusted to yield a natural frequency due to 
the gravitational field of ) 
(35, 


2 

Ws oe 

where R is the earth radius. Double integration 
of the accelerometer output yields the distance 
traveled. The distance errors due to incomplete 
compensation of the torsion wire suspension and 
fluid viscosity are very small and may be neg- 
lected entirely. The predominant term of the 
distance error due to incomplete acceleration 
compensation is derived as 


- Wi 
As=Wepy, « (36) 


Assuming the same physical system constants as 
before, the distance error after a 6,000 mile 
travel at a speed of 1,000 ft. s”™~ amounts to 
200 ft. The lateral deviations from the intended 
course originate from the pendulousness of the 
inertial wheel used for azimuth control, acceler- 
ometer errors and the bearing friction of the 
case. The deviations due to the first two error 
sources are predominant and amount to 

(37) 


= Ww £ 
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The lateral deviation due to bearing friction on 


the case is 
a 
YA LOW per: (38) 
o M0 = “Sheoved 
With the previously given values the total 
lateral deviation after 6,000 miles amounts to 
approximately 200 ft. 
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Space Operation 


The servo controlled inertia wheel system 
may also be applied advantageously to satellite 
and space vehicle control and guidance. The 
electrical power consumption is much lower than 
in gyroscopic devices with high speed motors. 
The operational life time depends only on the 
mean time to failure of the associated electronic 
components and thus can be expected to amount to 
years and decades. In addition, this system is 
much better adapted to the hostile environment 
of an orbital boost phase such as high accelera- 
tion and vibration levels. The drift rates in 
space will be lower than in terrestial applica- 
tions since the weightlessness eliminates all 
errors due to pendulousness and density varia- 
tions. Thus, the drift rates are only due to 
bearing friction, incomplete torsion wire com- 
pensation and Brownian motion. Under these 
conditions the drift rates can be expected to be 
of the order of 1079 deg/hr. 


Initial Conditions 


The nongyroscopic inertial reference system 
needs in contrast to gyro systems intelligence 
as to initial rate conditions. In terrestial 
applications this requirement is fulfilled by 
caging the device at the launch or take off site. 
In this manner the appropriate earth rate compo- 
nent is automatically introduced. In other 
applications where the requirement exists to 
generate an angular rate equivalent to gyro pre- 
cession this characteristic may be even advanta- 
geous since an initial impulse to the compensa- 
tion torque is sufficient to accomplish this. 

In satellite and space vehicle operations, the 
desirability exists for correcting the drift 
rates acquired in the boost phase by monitoring 
with tracking devices such as star trackers or 
sun followers. Since these optical or infrared 
devices can achieve accuracies of fractional 
seconds of arc, it appears that the accuracy 
potential of this device can be put to practical 
use in space navigation also. 


Conclusion 


The analysis of the nongyroscopic inertial 
reference and guidance system shows that the 
application of conventional servo techniques in 
combination with well established technologies 
leads to an accuracy potential that cannot be 
achieved by gyroscopic instruments. The basic 
reason for this is that the servo system in the 
case of the described system materially contrib- 
utes to an accuracy improvement whereas the 
servo system in the case of gyros does not. 
Also, the system accuracy in the nongyroscopic 
navigation system is directly proportional to 
the accelerometer accuracy which is not the case 
for gyroscopic navigation systems. This fact is 
of high significance since experience has taught 
that it is easier to build highly accurate accel- 
erometers than to build highly accurate gyros. 


Ref. 1 


The Air-bearing Gyro Stabilization Problem 
John P. Jagy, Missiles and Rockets, February 1958 
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SAMPLED DATA DESIGN BY LOG GAIN DIAGRAMS 


M. P. Pastel and G. J. Thaler 
U. S. Naval Postgraduate School 
Monterey, California 


Summary 


The bilinear transformation z = (l+w)/(1l-w) 
converts a z-transform function G(z) of a 
sampled-data system into a new function G(w), 
called the w-transform function, which is a 
rational function in variable w. This bilinear 
transformation maps the unit circle on the z- 
plane onto the imaginary axis of the w-plane. 
Consequently, it is now possible to readily 
draw log magnitude and phase diagrams against a 
frequency scale of the open-loop w-trans form 
function of a sampled-data system by use of 
asymptotic techniques. Then, by use of a 
Nichols chart and correlation information 
available from continuous systems, it is possi- 
ble to predict the approximate time domain 
performance. Design by modification of the 
open-loop transfer function can be made on the 
diagram in the same manner as employed for con- 
tinuous systems on the Bode diagram. The 
resulting w-transform can be converted to its 
equivalent Laplace transform. The ratio of 
this transform function and the original Laplace 
transform function of the system's equipment 
gives the required compensator. Remote s-plane 
poles may have to be added to have the compen- 
sator physically realizable. Restricting the 
modifying w-plane poles to lie between (0) and 
(-1) permits the compensator to be realizable 
as an RC network. 


Introduction 


In the last few years methods based on the 
z-transform have been advanced to aid in the 
analysis and design of sampled-data feedback 
control systems .1°229> In general, these 
methods have involved root-locus diagrams or 
Nyquist diagram techniques. However, when com- 
pared to the methods of designing continuous 
systems these z-transform techniques have two 
serious limitations. 


1. It is not possible to employ the Bode 
diagram method of analysis in which 
log magnitude and phase diagrams are 
plotted against a frequency scale by 
use of asymptotic techniques. 
Directly connecting a continuous com- 
pensator into the system requires 
complete recalculation of the system 
z-transfer function. 


It is the purpose of this paper to present 
an integrated straightforward method of design- 
ing sampled-data control systems which will not 
be subject to the above-mentioned limitations. 
It will be shown how restrictions on the method 
will permit utilization of continuous RC net- 
works for the compensator. 
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Construction of Log Magnitude and Phase Diagrams 


The z-transfer function G(z) is obtained 
from the pulse transfer function G*(s) by 
making the substitution 


z= aah (1) 
where T is the sampling period. The resulting 
z-transform is a rational function of z. The 


conformal mapping according to the relationship 
expressed by Equation 1 is shown in Figure 1 
where is the sampling frequency. It is sig- 
nificant that the jw axis on the s-plane maps 
into the unit circle on the z-plane. This 
indicates the difficulty associated with the 
technique of plotting log magnitude and phase 
versus a log frequency scale of the z-transfer 
function as the z variable traverses the unit 
circle. The various factors of the transform 
do not sequentially dominate the function and 
hence the asymptotic plotting techniques are 
not applicable. 


It has been sigeested” that this diffi- 
culty can be circumvented by a change of the 
independent variable given by the bilinear 
trans formation 


l+w 
CSP rger (2) 
and 
ena ok (3) 
i z+1 


Inasmuch as the transformation is linear, 
the new function G(w), called the w-transform 
function, remains a rational function of the 
variable w. The conformal mapping of the 
relation in Equation 3 is shown in Figure 2 
where it is seen that the unit circle on the 
z-plane has for its image the imaginary axis 
on the w-plane. Considering the complex quan- 
tity w as containing a real part u and an 
imaginary part v, a frequency response may be 
calculated for the transfer function by letting 

w= jv (4) 
Since v varies from zero to infinity the asymp- 
totic plotting techniques are directly applica- 
ble. Then, from the frequency response, 
relative stability may be predicted by use of 
the Nichols chart. 


As an illustration of this analysis method 
consider the sampled-data system shown in 
Figure 3 with 


1.34 


AEE RCE TE 


(5) 


and having a sampling frequency of 2x radians 
per second. The corresponding z-transform is 


0.847z 
G ES 
2 hae (EORTC a 368) (6) 
Substitution of the change of variable of 
Equation 2 into the above function yields 
_ 0.671(1 - w?) 
G(w) = (7) 
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The log magnitude and phase diagrams for 
this function against the variable v is shown 
in Figure 4. Transferring this log magnitude 
and phase locus to the Nichols chart, as is 
done in Figure 5, shows a resonance magnifica- 
tion of 43%. The presence of a resonance magni- 
fication indicates that a pole of the system 
function is in the proximity of the imaginary 
axis. It is evident that the closer the pole to 
the imaginary axis, the greater the resonance 
peak and the lower the degree of damping in the 
transient response. Only limited correlation 
data is available between frequency response and 
the output transient response for sampled-data 
systems .=? However, applying directly the 
standard correlation for a second order con- 
tinuous system predicts a peak overshoot of 28% 
which checks closely with the actual transient 
peak of 27.6%. The accuracy of the prediction 
in this case is due to the simplicity of the 
system and the high sampling frequency. However, 
less correlation between resonance peak and peak 
overshoot of the transient response should be 
expected for systems of more complexity and for 
systems employing a sampling frequency compar- 
able to the system bandwidth. 


Design with the w-Transform 


To employ the w-transform and the Bode dia- 
gram for analysis and design, it is important to 
consider some general qualities of w-transfer 
functions and its linear equivalent, the 
z-transfer function. The latter function is 
characterized by the highest power of z in the 
denominator exceeding that of the numerator by 
the number of sampling instants having a zero 
output after the first sampling instant at time 
equal to zero. Specifically, a Laplace transfer 
function having a denominator of two degrees or 
more higher than the numerator will have a cor- 
responding z-transform with the denominator only 
one degree higher than the numerator. Hence, 
the factored form of the z-transform will exhi- 
bit Z-plane zeros for which there may be no 
corresponding s-plane image. However, the 
z-plane poles of the transfer function have 
direct s-plane images given by Equation 1. 


When the substitution given by Equation 2 
is employed, the factored G(w) function has the 
same number of poles as the G(z) function from 
which it was derived. However, the number of 
zeros equals the number of poles with all the 
additional zeros occurring at 1.0. Thus, any 
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Bode diagram of a w-transfer function must 
satisfy these requirements. 


Inspection of Figures 1 and 2 shows that 
the left hand half of the s-plane maps into the 
left hand half of the w-plane. Consequently, 
for physical systems w-plane poles should be 
chosen in the left hand plane. However, the 
same restrictions do not apply to the zeros. 


Within the restrictions discussed in the 
preceding paragraphs, an original G,(w) may be 
modified on the Bode diagram to satisfy specifi- 
cations. If, as is usually the case, the com- 
pensator is not permitted to have a pole at 
infinity, the finally selected transfer function 
Go(w) must have the same or greater difference 
between the number of poles and zeros other than 
those at 1.0 as found in the transfer function 
Gy (w) ° 


Go(w) may be converted into its equivalent 
Laplace transfer function Go(s) and the transfer 
function of the compensator G,(s) found by 
simple division. 


Ga(s) 


G3 (8) (8) 


G.(s) = 


Because of the lack of correspondence 
between the number of s-plane zeros and w-plane 
zeros, the function G,(s) derived from Equation 8 
will in many cases have more zeros than poles. 
The requirement for a pole at infinity may be 
circumvented in such cases by approximating the 
compensator with remote poles on the negative 
real s-plane axis, such as is done in the 
Guillemin direct synthesis procedure for contin- 
uous systems.’ These additional poles have 
negligible effect on the system response. The 
final system then has the form shown in Figure 6 
with the compensator cascaded directly into the 
fixed parts of the system. 


Compensating with RC network 


RC 
because 


networks are attractive as compensators 
of their economy in cost and space as 
well as ease of assembly. However, to employ 
only RC networks additional restrictions are 
required for the final form of the Ga(w) 
function. 


Network synthesis theory lists the follow- 
ing physical realizability conditions for RC 
transfer functions. 


1. The poles are simple and restricted to 
the negative real axis excluding the 
origin or infinity. 

2. The zeros may be of any order and 


anywhere. 


The first requirement means that added w-poles 
must be placed on the real w-plane axis from 
(0.0) to (-1.0). The second requirement gives 
complete freedom to the selection of w-zeros. 


Example 


As a complete example of the methods pre- 
sented in this paper, consider a system having 
a sampling period of one second and a transfer 
function 


2.24 
G3 (8)5 5 (peri) (692) ie) 
-448z(z - 0.368 

Gi(z) " (rij (z - .368) (z - 1354) £39) 

The corresponding w-transform is then 

w 

56(1-w)(w 1)G7yest 

QO) Oo SS eee (11) 
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Figure 7 shows the Bode diagram for Equa- 
tion 11 and by use of the Nichols chart in 
Figure 8 the transient peak overshoot is pre- 
dicted as 53%. Compensating the system with a 
phase lag network with a w-plane pole at -0.02 
and a w-plane zero at -0.07 and holding the low 
frequency gain constant yields a new function 


Go(w) = 
: w(5 +) Hea tO TTY 


(12) 


The predicted transient response overshoot is 
25%. The actual transient output sequence of 
samples has a peak overshoot of 27.6%. Conse- 
quently, the system as compensated is considered 
satisfactory. The corresponding Laplace trans- 
fer function is then 


-0289(s+ .14)(s+ 22.31) 


Gate) ee eat 041) (5 +1) (s F 2) 


(13) 


Without approximation this leads to a compensa- 
tion function 


-0129(s+ .14)(s +22.31) 


Este (s + .041) 


(14) 
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Equation 14 can be made RC realizable with 
negligible effect on the system response by 
adding a pole at (-40). This yields an RC 
realizable compensation function 


.516(s + .14) (s+ 22.31) 


(s + .041)(s +40) G3) 


This completes the design. A similar pro- 
cedure can be used with other system functions. 
Further check on the suitability of the transient 
response between sampling instants can be made 
by employing the modified z-transformation 
integral.8 
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Fig. 3. Sampled-data feedback system. 


-/6L— = . 
-(80 -14-0 PHASE -% 


Fig. 5. Nichols Plot for system in example. 
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Fig. 4. Attenuation and phase plot for system of example. 
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Fig. 6. Compensated sampled-data feedback system. 
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Fig. 8. Nichols Plot for compensated and uncompensated 
systems. 


zac 


ip 
ei 


LJ 
i 
a 


| 
et 


E 


— 
Es 
> 
7.) 


a 
8 


= 
VA 


Se 


Fig. 7. Attenuation and phase plot for uncompensated and compensated systems. 
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stitutional Listings from other firms interested in the field of Automatic 
Control. 


a 


RAMO-WOOLDRIDGE, DIV. OF THOMPSON RAMO WOOLDRIDGE INC., P.O. Box 90534, Airport Station, Los Angeles 45, Calif. 
% Electronic Research and Development 


PHILCO CORP., GOVERNMENT & INDUSTRIAL DIV., 4700 Wissahickon Ave., Philadelphia 44, Pa 
Transac S-2000 All Transistor, Large-Scale Data-Processing Systems; Transac Computers 


The charge for an Institutional Listing is $75.00 per issue or $125.00 for two 
consecutive issues. Applications for Institutional Listings and checks (made 
out to the Institute of Radio Engineers, Inc.) should be sent to Mr. L. G. 


Cumming, Technical Secretary, Institute of Radio Engineers, Inc., 1 East 
79th Street, New York 21, N. Y. 


